[llvm-testresults] pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jan 18 23:29:50 PST 2014


http://llvm.org/perf/db_default/v4/nts/20796?compare_to=20784&baseline=19899
Nickname: pollyperf-O3-polly-detect__clang_DEV__x86_64:35

Comparing:
     Run: 20796, Order: 199569, Start Time: 2014-01-19 02:47:13, End Time: 2014-01-19 07:34:44
      To: 20784, Order: 199560, Start Time: 2014-01-18 21:52:14, End Time: 2014-01-19 02:38:57
Baseline: 19899, Order: 198654, Start Time: 2014-01-07 01:22:04, End Time: 2014-01-07 06:18:02

===============
Tests Summary
===============

Performance Regressions: 24 (37 on baseline)
Performance Improvements: 0 (1 on baseline)
Unchanged Tests: 1086 (1072 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-12-MinIntProblem: 300.00% (0.0040 => 0.0160, std.dev.: 0.0043)
  SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 150.00% (0.0080 => 0.0200, std.dev.: 0.0032)
  SingleSource/UnitTests/2003-07-10-SignConversions: 150.00% (0.0080 => 0.0200, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/lowercase: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044)
  SingleSource/Regression/C++/EH/recursive-throw: 75.00% (0.0160 => 0.0280, std.dev.: 0.0039)
  SingleSource/UnitTests/SignlessTypes/ccc: 75.00% (0.0160 => 0.0280, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 44.44% (0.0360 => 0.0520, std.dev.: 0.0061)
  SingleSource/Benchmarks/Stanford/Towers: 40.00% (0.0400 => 0.0560, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/salsa20: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/ffbench: 17.39% (0.0920 => 0.1080, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 11.84% (0.3040 => 0.3400, std.dev.: 0.0065)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 9.68% (0.1240 => 0.1360, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.17% (0.3240 => 0.3440, std.dev.: 0.0059)
  MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.61% (1.2401 => 1.2601, std.dev.: 0.0074)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.52% (1.0561 => 1.0721, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.28% (5.3320 => 5.4000, std.dev.: 0.0221)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 15.12% (1.1641 => 1.3401, std.dev.: 0.0203)
  MultiSource/Benchmarks/Olden/health/health: 7.53% (0.3720 => 0.4000, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 4.92% (0.2440 => 0.2560, std.dev.: 0.0041)
  MultiSource/Applications/obsequi/Obsequi: 3.52% (2.0441 => 2.1161, std.dev.: 0.0153)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.13% (0.5120 => 0.5280, std.dev.: 0.0062)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.19% (5.0563 => 5.1163, std.dev.: 0.0134)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-07-10-SignConversions: 400.00% (0.0040 => 0.0200, std.dev.: 0.0038)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 150.00% (0.0080 => 0.0200, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/salsa20: 20.00% (0.0600 => 0.0720, std.dev.: 0.0043)
  SingleSource/Benchmarks/McGill/misr: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/power/power: 18.42% (0.1520 => 0.1800, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 13.33% (0.1800 => 0.2040, std.dev.: 0.0076)
  SingleSource/Benchmarks/SmallPT/smallpt: 11.76% (0.1360 => 0.1520, std.dev.: 0.0042)
  SingleSource/UnitTests/Vector/SSE/sse_expandfft: 8.82% (0.1360 => 0.1480, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/ary: 7.14% (0.2800 => 0.3000, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/methcall: 7.02% (0.2280 => 0.2440, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.47% (0.6800 => 0.7240, std.dev.: 0.0072)
  MultiSource/Benchmarks/FreeBench/neural/neural: 6.00% (0.2000 => 0.2120, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.95% (0.3360 => 0.3560, std.dev.: 0.0062)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 4.39% (0.4560 => 0.4760, std.dev.: 0.0059)
  MultiSource/Applications/minisat/minisat: 3.83% (0.8360 => 0.8680, std.dev.: 0.0073)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.47% (9.5802 => 9.9122, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.07% (1.1721 => 1.2081, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.06% (1.1761 => 1.2121, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.67% (1.2001 => 1.2321, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.63% (1.3681 => 1.4041, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.47% (1.1321 => 1.1601, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.39% (1.1721 => 1.2001, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.27% (1.2321 => 1.2601, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.10% (1.1441 => 1.1681, std.dev.: 0.0089)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.06% (11.4440 => 11.6800, std.dev.: 0.0459)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.03% (1.1841 => 1.2081, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.90% (1.0521 => 1.0721, std.dev.: 0.0043)
  MultiSource/Applications/JM/ldecod/ldecod: 1.49% (8.5802 => 8.7082, std.dev.: 0.0291)
  MultiSource/Applications/oggenc/oggenc: 1.40% (6.2844 => 6.3724, std.dev.: 0.0178)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.20% (5.3360 => 5.4000, std.dev.: 0.0221)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.05% (11.3843 => 11.5043, std.dev.: 0.0390)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 10.67% (0.3000 => 0.3320, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.77% (1.2321 => 1.3401, std.dev.: 0.0203)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.47% (0.2360 => 0.2560, std.dev.: 0.0041)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 6.13% (3.9842 => 4.2283, std.dev.: 0.0111)
  MultiSource/Applications/sqlite3/sqlite3: 1.18% (4.0563 => 4.1043, std.dev.: 0.0132)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -4.52% (1.2401 => 1.1841, std.dev.: 0.0146)

Report Time: 1.84s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140119/ad8308ad/attachment.html>


More information about the llvm-testresults mailing list