[llvm-testresults] pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 10 04:36:25 PST 2014


http://llvm.org/perf/db_default/v4/nts/20195?compare_to=20192&baseline=19898
Nickname: pollyperf-O3__clang_DEV__x86_64:34

Comparing:
     Run: 20195, Order: 198920, Start Time: 2014-01-10 07:57:14, End Time: 2014-01-10 12:41:07
      To: 20192, Order: 198918, Start Time: 2014-01-10 07:08:26, End Time: 2014-01-10 11:50:29
Baseline: 19898, Order: 198654, Start Time: 2014-01-07 01:21:49, End Time: 2014-01-07 06:07:29

===============
Tests Summary
===============

Performance Regressions: 20 (19 on baseline)
Performance Improvements: 2 (1 on baseline)
Unchanged Tests: 1088 (1090 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout/strcat: 50.00% (0.0240 => 0.0360, std.dev.: 0.0044)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 50.00% (0.0240 => 0.0360, std.dev.: 0.0042)
  MultiSource/Benchmarks/llubenchmark/llu: 44.44% (0.0360 => 0.0520, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc/flops-2: 42.86% (0.0280 => 0.0400, std.dev.: 0.0042)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 21.05% (0.0760 => 0.0920, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 18.75% (0.0640 => 0.0760, std.dev.: 0.0032)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 16.00% (0.1000 => 0.1160, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 12.50% (0.0960 => 0.1080, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 12.50% (0.1280 => 0.1440, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.14% (0.2760 => 0.3040, std.dev.: 0.0040)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 9.38% (0.1280 => 0.1400, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.74% (0.4280 => 0.4440, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.9480 => 0.9680, std.dev.: 0.0076)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/strcat: 27.59% (0.1160 => 0.1480, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 7.69% (0.3640 => 0.3920, std.dev.: 0.0092)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.10% (0.3280 => 0.3480, std.dev.: 0.0077)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 4.52% (3.3602 => 3.5122, std.dev.: 0.0498)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.61% (0.4600 => 0.4720, std.dev.: 0.0044)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -50.00% (0.0240 => 0.0120, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.24% (3.9282 => 3.8402, std.dev.: 0.0293)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0044)
  SingleSource/Regression/C++/EH/dead_try_block: 150.00% (0.0080 => 0.0200, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 133.33% (0.0120 => 0.0280, std.dev.: 0.0032)
  SingleSource/UnitTests/SignlessTypes/shr: 50.00% (0.0240 => 0.0360, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 25.00% (0.0480 => 0.0600, std.dev.: 0.0032)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 20.83% (0.0960 => 0.1160, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 17.65% (0.0680 => 0.0800, std.dev.: 0.0031)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 12.90% (0.1240 => 0.1400, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.04% (0.2840 => 0.3040, std.dev.: 0.0040)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.61% (0.6640 => 0.6880, std.dev.: 0.0080)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.11% (0.9480 => 0.9680, std.dev.: 0.0076)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.66% (6.0160 => 6.1160, std.dev.: 0.0328)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.64% (1.2201 => 1.2401, std.dev.: 0.0054)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 21.05% (0.0760 => 0.0920, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout/strcat: 15.62% (0.1280 => 0.1480, std.dev.: 0.0067)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.91% (3.3802 => 3.5122, std.dev.: 0.0498)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.75% (0.9601 => 0.9961, std.dev.: 0.0088)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (3.9202 => 3.8402, std.dev.: 0.0293)

Report Time: 4.28s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140110/9572cbe0/attachment.html>


More information about the llvm-testresults mailing list