[llvm-testresults] pollyperf3__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Dec 21 02:31:35 PST 2013


http://llvm.org/perf/db_default/v4/nts/18784?compare_to=18773&baseline=18569
Nickname: pollyperf3__pollyperf-O3__clang_DEV__x86_64:26

Comparing:
     Run: 18784, Order: 197856, Start Time: 2013-12-21 05:45:46, End Time: 2013-12-21 10:35:48
      To: 18773, Order: 197844, Start Time: 2013-12-20 23:46:24, End Time: 2013-12-21 04:36:27
Baseline: 18569, Order: 197553, Start Time: 2013-12-18 09:17:34, End Time: 2013-12-18 14:27:44

===============
Tests Summary
===============

Performance Regressions: 21 (23 on baseline)
Performance Improvements: 2 (7 on baseline)
Unchanged Tests: 1087 (1080 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/pi: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027)
  SingleSource/UnitTests/2003-05-26-Shorts: 100.00% (0.0120 => 0.0240, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 30.00% (0.0800 => 0.1040, std.dev.: 0.0048)
  SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 24.49% (0.1960 => 0.2440, std.dev.: 0.0149)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 16.67% (0.0720 => 0.0840, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 16.67% (0.0720 => 0.0840, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/ffbench: 15.79% (0.0760 => 0.0880, std.dev.: 0.0037)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.12% (0.2640 => 0.2960, std.dev.: 0.0054)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 9.30% (0.1720 => 0.1880, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout-C++/matrix: 7.94% (0.2520 => 0.2720, std.dev.: 0.0068)
  MultiSource/Benchmarks/McCat/09-vor/vor: 6.82% (0.3520 => 0.3760, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.94% (0.6480 => 0.6800, std.dev.: 0.0100)
  SingleSource/Benchmarks/Shootout-C++/moments: 2.80% (0.4280 => 0.4400, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.38% (1.5120 => 1.5480, std.dev.: 0.0112)
  MultiSource/Benchmarks/nbench/nbench: 2.25% (1.2440 => 1.2720, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.08% (1.3481 => 1.3761, std.dev.: 0.0099)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.03% (0.7880 => 0.8040, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.95% (1.2321 => 1.2561, std.dev.: 0.0069)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 10.34% (0.2320 => 0.2560, std.dev.: 0.0053)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/llubenchmark/llu: -26.67% (0.0600 => 0.0440, std.dev.: 0.0061)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.94% (3.9202 => 3.8442, std.dev.: 0.0277)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027)
  SingleSource/Regression/C/sumarray2d: 80.00% (0.0200 => 0.0360, std.dev.: 0.0035)
  SingleSource/Regression/C/casts: 42.86% (0.0280 => 0.0400, std.dev.: 0.0037)
  SingleSource/Benchmarks/Stanford/IntMM: 30.00% (0.0400 => 0.0520, std.dev.: 0.0027)
  MultiSource/Applications/viterbi/viterbi: 15.91% (0.1760 => 0.2040, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.82% (0.1360 => 0.1480, std.dev.: 0.0032)
  SingleSource/Benchmarks/SmallPT/smallpt: 8.82% (0.1360 => 0.1480, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/constpool: 7.89% (10.3446 => 11.1607, std.dev.: 0.1265)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.25% (0.2760 => 0.2960, std.dev.: 0.0054)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 4.05% (0.2960 => 0.3080, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.4240 => 0.4400, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 3.70% (1.1881 => 1.2321, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.95% (1.2201 => 1.2561, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.73% (1.1721 => 1.2041, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.64% (1.2121 => 1.2441, std.dev.: 0.0045)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.55% (0.7840 => 0.8040, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.55% (1.2561 => 1.2881, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.33% (1.2041 => 1.2321, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.77% (0.9041 => 0.9201, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.75% (1.1401 => 1.1601, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.70% (1.1761 => 1.1961, std.dev.: 0.0066)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.47% (0.2360 => 0.2560, std.dev.: 0.0053)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.73% (0.9641 => 1.0001, std.dev.: 0.0102)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -64.59% (139.6807 => 49.4551, std.dev.: 25.3997)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -62.93% (89.9296 => 33.3341, std.dev.: 17.5660)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -59.71% (43.2667 => 17.4331, std.dev.: 8.8381)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -24.27% (3.1642 => 2.3961, std.dev.: 0.0846)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.52% (37.3983 => 29.3498, std.dev.: 0.6251)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.24% (3.9322 => 3.8442, std.dev.: 0.0277)
  SingleSource/Benchmarks/Shootout/ary3: -1.01% (3.5562 => 3.5202, std.dev.: 0.0095)

Report Time: 2.36s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131221/66a3dd38/attachment.html>


More information about the llvm-testresults mailing list