[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 25 19:22:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12760?compare_to=12757&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12760, Order: 184892, Start Time: 2013-06-26 00:39:38, End Time: 2013-06-26 02:23:31
      To: 12757, Order: 184875, Start Time: 2013-06-25 22:23:34, End Time: 2013-06-26 00:17:46
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 3 (20 on baseline)
Performance Improvements: 67 (60 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1037 (1027 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: 7.64% (0.1349 => 0.1452, std.dev.: 0.0009)
  MultiSource/Applications/spiff/spiff: 3.86% (2.8699 => 2.9806, std.dev.: 0.0204)
  SingleSource/Benchmarks/Shootout/methcall: 1.79% (8.3162 => 8.4654, std.dev.: 0.0527)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-05-26-Shorts: -39.07% (0.0389 => 0.0237, std.dev.: 0.0058)
  SingleSource/UnitTests/2003-05-07-VarArgs: -37.71% (0.0411 => 0.0256, std.dev.: 0.0024)
  SingleSource/UnitTests/2002-10-12-StructureArgs: -37.41% (0.0286 => 0.0179, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -36.57% (0.1162 => 0.0737, std.dev.: 0.0024)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -36.31% (1.8604 => 1.1849, std.dev.: 0.0129)
  MultiSource/Benchmarks/Olden/health/health: -35.96% (0.2439 => 0.1562, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-07-09-LoadShorts: -32.92% (0.0404 => 0.0271, std.dev.: 0.0019)
  MultiSource/Benchmarks/Olden/tsp/tsp: -31.09% (0.1904 => 0.1312, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -28.07% (0.1190 => 0.0856, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -27.13% (0.3096 => 0.2256, std.dev.: 0.0026)
  MultiSource/Benchmarks/MallocBench/gs/gs: -26.67% (6.2930 => 4.6144, std.dev.: 0.1487)
  MultiSource/Benchmarks/Olden/mst/mst: -26.36% (0.1844 => 0.1358, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -26.00% (0.0677 => 0.0501, std.dev.: 0.0009)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -25.69% (1.6059 => 1.1933, std.dev.: 0.0211)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -22.94% (0.3658 => 0.2819, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -21.65% (1.6689 => 1.3075, std.dev.: 0.0068)
  MultiSource/Benchmarks/Olden/power/power: -17.78% (0.1749 => 0.1438, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -17.26% (1.9795 => 1.6378, std.dev.: 0.0583)
  MultiSource/Applications/obsequi/Obsequi: -16.71% (1.4062 => 1.1712, std.dev.: 0.0057)
  MultiSource/Applications/viterbi/viterbi: -13.86% (0.2114 => 0.1821, std.dev.: 0.0077)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -13.56% (0.0885 => 0.0765, std.dev.: 0.0021)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.77% (0.8120 => 0.7164, std.dev.: 0.0037)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -11.23% (0.1603 => 0.1423, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -11.16% (1.5690 => 1.3939, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -10.85% (1.9295 => 1.7201, std.dev.: 0.0157)
  MultiSource/Applications/lua/lua: -8.82% (4.7605 => 4.3404, std.dev.: 0.1133)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.09% (0.1890 => 0.1756, std.dev.: 0.0004)
  MultiSource/Applications/kimwitu++/kc: -6.75% (20.5670 => 19.1779, std.dev.: 0.3071)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.67% (1.8116 => 1.6907, std.dev.: 0.0419)
  MultiSource/Applications/lemon/lemon: -6.32% (1.3060 => 1.2234, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.21% (1.7762 => 1.6659, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.77% (1.7987 => 1.6949, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.27% (1.6341 => 1.5480, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.20% (1.7139 => 1.6248, std.dev.: 0.0205)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.16% (27.1760 => 25.7727, std.dev.: 0.4837)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.99% (1.7118 => 1.6263, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.80% (1.4527 => 1.3829, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.68% (1.7574 => 1.6751, std.dev.: 0.0135)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.67% (0.5477 => 0.5221, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.24% (6.6308 => 6.3495, std.dev.: 0.1081)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -45.15% (0.2421 => 0.1328, std.dev.: 0.0071)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -34.12% (0.0337 => 0.0222, std.dev.: 0.0000)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -32.46% (0.0767 => 0.0518, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -31.20% (1.2622 => 0.8684, std.dev.: 0.0224)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.06% (0.9463 => 0.6713, std.dev.: 0.0195)
  MultiSource/Applications/kimwitu++/kc: -18.98% (0.0606 => 0.0491, std.dev.: 0.0024)
  MultiSource/Applications/minisat/minisat: -14.80% (7.2553 => 6.1813, std.dev.: 0.2751)
  MultiSource/Benchmarks/MallocBench/gs/gs: -13.43% (0.0886 => 0.0767, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/health/health: -11.83% (0.3727 => 0.3286, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.60% (0.3501 => 0.3095, std.dev.: 0.0020)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -10.84% (1.2554 => 1.1193, std.dev.: 0.0022)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -8.97% (0.3646 => 0.3319, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/tsp/tsp: -8.83% (1.7535 => 1.5986, std.dev.: 0.0192)
  MultiSource/Applications/obsequi/Obsequi: -6.40% (2.3548 => 2.2042, std.dev.: 0.0059)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -5.84% (1.3466 => 1.2679, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -5.44% (0.4158 => 0.3932, std.dev.: 0.0033)
  MultiSource/Benchmarks/llubenchmark/llu: -5.42% (2.1188 => 2.0040, std.dev.: 0.0167)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.39% (95.0821 => 90.9037, std.dev.: 0.3733)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.82% (2.8852 => 2.7750, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/ffbench: -2.74% (1.4136 => 1.3749, std.dev.: 0.0111)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.55% (4.1455 => 4.0398, std.dev.: 0.0298)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.00% (3.7029 => 3.6290, std.dev.: 0.0283)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.79% (1.6634 => 1.6337, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.43% (5.4349 => 5.3572, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.22% (2.9292 => 2.8935, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.20% (9.2654 => 9.1539, std.dev.: 0.0427)
  MultiSource/Benchmarks/Olden/power/power: -1.11% (1.2663 => 1.2523, std.dev.: 0.0013)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -8.20% (0.1500 => 0.1377, std.dev.: 0.0128)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.50% (0.2721 => 0.2898, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.20% (1.6070 => 1.6263, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.19% (1.3667 => 1.3829, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 29.41% (1.1695 => 1.5134, std.dev.: 0.0046)
  SingleSource/Benchmarks/Stanford/Puzzle: 19.93% (0.1455 => 0.1745, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.01% (6.1372 => 7.1197, std.dev.: 0.1674)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.51% (0.9806 => 1.1327, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.89% (5.2003 => 5.6107, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.96% (3.1853 => 3.3751, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.88% (3.2201 => 3.3773, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.65% (4.6639 => 4.8809, std.dev.: 0.0202)
  MultiSource/Applications/spiff/spiff: 4.45% (2.8536 => 2.9806, std.dev.: 0.0204)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.24% (1.0571 => 1.1019, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.06% (2.8994 => 3.0170, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.73% (5.9362 => 6.1578, std.dev.: 0.0146)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.72% (1.2224 => 1.2679, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.57% (5.2788 => 5.4675, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.94% (5.5010 => 5.6629, std.dev.: 0.0016)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.48% (4.3727 => 4.4812, std.dev.: 0.0015)
  MultiSource/Benchmarks/sim/sim: 2.26% (3.8805 => 3.9683, std.dev.: 0.0078)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -35.67% (0.1113 => 0.0716, std.dev.: 0.0009)
  MultiSource/Applications/viterbi/viterbi: -25.09% (0.2431 => 0.1821, std.dev.: 0.0077)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.94% (0.0803 => 0.0675, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.41% (0.7918 => 0.6856, std.dev.: 0.0367)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.07% (0.2006 => 0.1804, std.dev.: 0.0066)
  MultiSource/Benchmarks/Olden/tsp/tsp: -7.93% (0.1425 => 0.1312, std.dev.: 0.0031)
  MultiSource/Applications/lemon/lemon: -7.00% (1.3155 => 1.2234, std.dev.: 0.0303)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.03% (0.4199 => 0.3988, std.dev.: 0.0063)
  MultiSource/Applications/kimwitu++/kc: -4.99% (20.1855 => 19.1779, std.dev.: 0.3071)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.46% (1.3686 => 1.3075, std.dev.: 0.0068)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.25% (0.2753 => 0.2636, std.dev.: 0.0021)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.51% (0.2961 => 0.2857, std.dev.: 0.0019)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.32% (0.7334 => 0.7164, std.dev.: 0.0037)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.40% (1.2911 => 0.7307, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.40% (4.4050 => 2.7135, std.dev.: 0.0383)
  MultiSource/Benchmarks/Olden/mst/mst: -36.73% (0.2099 => 0.1328, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/bisort/bisort: -22.00% (0.8606 => 0.6713, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.03% (4.8986 => 3.8684, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/salsa20: -20.16% (10.3398 => 8.2549, std.dev.: 0.3611)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.14% (5.7264 => 4.5731, std.dev.: 0.0366)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.91% (6.2328 => 5.0540, std.dev.: 0.0332)
  MultiSource/Benchmarks/FreeBench/neural/neural: -18.67% (0.3513 => 0.2857, std.dev.: 0.0180)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.28% (25.3677 => 21.2380, std.dev.: 0.1324)
  MultiSource/Applications/minisat/minisat: -16.13% (7.3703 => 6.1813, std.dev.: 0.2751)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -15.29% (1.0251 => 0.8684, std.dev.: 0.0224)
  MultiSource/Benchmarks/mafft/pairlocalalign: -14.17% (48.3307 => 41.4841, std.dev.: 0.1787)
  MultiSource/Benchmarks/nbench/nbench: -13.53% (22.3004 => 19.2839, std.dev.: 1.0592)
  MultiSource/Benchmarks/MallocBench/gs/gs: -11.74% (0.0869 => 0.0767, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -8.68% (0.2973 => 0.2715, std.dev.: 0.0025)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.63% (1.6679 => 1.5240, std.dev.: 0.0169)
  MultiSource/Applications/siod/siod: -8.10% (3.7240 => 3.4225, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.54% (3.2030 => 2.9614, std.dev.: 0.0515)
  MultiSource/Applications/sqlite3/sqlite3: -7.46% (4.6358 => 4.2901, std.dev.: 0.0995)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.28% (9.8728 => 9.1539, std.dev.: 0.0427)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -7.25% (0.1945 => 0.1804, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.24% (4.5717 => 4.2405, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.92% (5.5889 => 5.2023, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc/flops: -5.76% (10.2170 => 9.6286, std.dev.: 0.0880)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.67% (5.3184 => 5.0700, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.19% (5.3276 => 5.1045, std.dev.: 0.0019)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.00% (9.1099 => 8.7459, std.dev.: 0.0265)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.77% (1.6613 => 1.5986, std.dev.: 0.0192)
  MultiSource/Applications/hexxagon/hexxagon: -3.75% (15.4979 => 14.9170, std.dev.: 0.2130)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.60% (94.2966 => 90.9037, std.dev.: 0.3733)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -3.52% (0.3208 => 0.3095, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.43% (2.4808 => 2.3956, std.dev.: 0.0305)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7794, std.dev.: 0.0063)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.87% (3.8665 => 3.7557, std.dev.: 0.0161)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.76% (2.8537 => 2.7750, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.54% (6.3757 => 6.2140, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.24% (4.5094 => 4.4082, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.24% (5.4801 => 5.3572, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.03% (8.5243 => 8.3510, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.84% (4.2167 => 4.1392, std.dev.: 0.0073)
  MultiSource/Applications/obsequi/Obsequi: -1.59% (2.2398 => 2.2042, std.dev.: 0.0059)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.40% (2.8573 => 2.8173, std.dev.: 0.0074)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.32% (12.1841 => 12.0227, std.dev.: 0.0481)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.25% (1.6980 => 1.6767, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.22% (9.6556 => 9.5375, std.dev.: 0.0392)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.03% (5.9068 => 5.8459, std.dev.: 0.0221)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.44% (0.1441 => 0.1377, std.dev.: 0.0128)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130625/e7f6f877/attachment.html>


More information about the llvm-testresults mailing list