[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 29 20:11:34 PST 2013


http://llvm.org/perf/db_default/v4/nts/19304?compare_to=19279&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19304, Order: 198176, Start Time: 2013-12-29 23:26:33, End Time: 2013-12-30 04:16:03
      To: 19279, Order: 198169, Start Time: 2013-12-29 18:19:47, End Time: 2013-12-29 23:09:08
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 17 (43 on baseline)
Performance Improvements: 0 (7 on baseline)
Unchanged Tests: 1093 (1060 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/TestLoop: 400.00% (0.0040 => 0.0200, std.dev.: 0.0042)
  SingleSource/UnitTests/2002-05-03-NotTest: 300.00% (0.0040 => 0.0160, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/sumarray-dbl: 75.00% (0.0160 => 0.0280, std.dev.: 0.0041)
  SingleSource/Regression/C++/EH/exception_spec_test: 66.67% (0.0240 => 0.0400, std.dev.: 0.0041)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/flops-4: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/bisort/bisort: 33.33% (0.0600 => 0.0800, std.dev.: 0.0065)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 28.57% (0.0560 => 0.0720, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/fbench: 22.22% (0.0720 => 0.0880, std.dev.: 0.0042)
  MultiSource/Benchmarks/BitBench/five11/five11: 20.00% (0.0600 => 0.0720, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.62% (0.2080 => 0.2280, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 9.09% (0.3520 => 0.3840, std.dev.: 0.0075)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.09% (0.2200 => 0.2400, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout-C++/lists: 6.85% (0.2920 => 0.3120, std.dev.: 0.0053)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 5.03% (1.2720 => 1.3360, std.dev.: 0.0155)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.70% (0.5400 => 0.5600, std.dev.: 0.0073)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.50% (0.1600 => 0.1720, std.dev.: 0.0033)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 150.00% (0.0080 => 0.0200, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0045)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 50.00% (0.0240 => 0.0360, std.dev.: 0.0030)
  SingleSource/Benchmarks/McGill/exptree: 18.18% (0.0880 => 0.1040, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 10.00% (0.2400 => 0.2640, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2240 => 0.2440, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 8.33% (0.2400 => 0.2600, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3560 => 0.3800, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 6.67% (0.3000 => 0.3200, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.45% (0.2480 => 0.2640, std.dev.: 0.0062)
  SingleSource/UnitTests/Vector/constpool: 6.39% (10.3246 => 10.9847, std.dev.: 0.1238)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.52% (1.4480 => 1.5280, std.dev.: 0.0200)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.12% (1.1521 => 1.1881, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.83% (1.1321 => 1.1641, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.71% (1.1801 => 1.2121, std.dev.: 0.0111)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.70% (1.0361 => 1.0641, std.dev.: 0.0069)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.17% (11.2203 => 11.4643, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.14% (1.1201 => 1.1441, std.dev.: 0.0082)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.03% (6.7040 => 6.8400, std.dev.: 0.0429)
  MultiSource/Applications/lemon/lemon: 1.89% (1.4801 => 1.5081, std.dev.: 0.0065)
  MultiSource/Applications/JM/lencod/lencod: 1.78% (19.2805 => 19.6246, std.dev.: 0.0400)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.75% (1.3681 => 1.3921, std.dev.: 0.0090)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.72% (9.5162 => 9.6802, std.dev.: 0.0502)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.71% (1.1721 => 1.1921, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.70% (1.1761 => 1.1961, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.69% (1.1801 => 1.2001, std.dev.: 0.0065)
  MultiSource/Applications/oggenc/oggenc: 1.60% (6.2644 => 6.3644, std.dev.: 0.0213)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.57% (16.5123 => 16.7723, std.dev.: 0.0617)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.56% (1.2841 => 1.3041, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.51% (5.3080 => 5.3880, std.dev.: 0.0278)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.50% (11.4520 => 11.6240, std.dev.: 0.0289)
  MultiSource/Applications/SPASS/SPASS: 1.44% (18.5724 => 18.8406, std.dev.: 0.0492)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.43% (1.6841 => 1.7081, std.dev.: 0.0092)
  MultiSource/Applications/sqlite3/sqlite3: 1.40% (24.2975 => 24.6375, std.dev.: 0.0381)
  MultiSource/Applications/ClamAV/clamscan: 1.33% (19.0163 => 19.2683, std.dev.: 0.0565)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.32% (4.2323 => 4.2883, std.dev.: 0.0098)
  MultiSource/Applications/JM/ldecod/ldecod: 1.32% (8.5002 => 8.6122, std.dev.: 0.0342)
  MultiSource/Benchmarks/Bullet/bullet: 1.18% (38.5246 => 38.9806, std.dev.: 0.0963)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.13% (28.9458 => 29.2738, std.dev.: 0.0603)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Treesort: 20.00% (0.0600 => 0.0720, std.dev.: 0.0039)
  MultiSource/Benchmarks/llubenchmark/llu: 5.13% (5.0723 => 5.3323, std.dev.: 0.0783)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.10% (2.9202 => 2.9522, std.dev.: 0.0084)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.20% (97.4941 => 32.9541, std.dev.: 21.3928)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.09% (145.2571 => 49.2511, std.dev.: 31.7900)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.13% (46.2869 => 17.0651, std.dev.: 11.0938)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.97% (3.3282 => 2.3641, std.dev.: 0.1135)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.35% (38.3664 => 29.0258, std.dev.: 0.7020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.93% (6.5084 => 6.2524, std.dev.: 0.0859)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.12% (1.3201 => 1.2921, std.dev.: 0.0076)

Report Time: 2.54s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131229/ec66344d/attachment.html>


More information about the llvm-testresults mailing list