[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Jan 4 08:32:04 PST 2014


http://llvm.org/perf/db_default/v4/nts/19673?compare_to=19658&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19673, Order: 198480, Start Time: 2014-01-04 11:50:41, End Time: 2014-01-04 16:36:39
      To: 19658, Order: 198445, Start Time: 2014-01-03 20:36:20, End Time: 2014-01-04 01:22:19
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

New Failures: 2 (2 on baseline)
Performance Regressions: 10 (39 on baseline)
Performance Improvements: 1 (7 on baseline)
Unchanged Tests: 1097 (1062 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: -1.34% (19.6846 => 19.4206, std.dev.: 0.0461)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1245 => 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/compare: 75.00% (0.0160 => 0.0280, std.dev.: 0.0044)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: 75.00% (0.0160 => 0.0280, std.dev.: 0.0040)
  SingleSource/UnitTests/2003-08-11-VaListArg: 42.86% (0.0280 => 0.0400, std.dev.: 0.0045)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 23.08% (0.0520 => 0.0640, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.79% (0.0760 => 0.0880, std.dev.: 0.0030)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.24% (0.3400 => 0.3680, std.dev.: 0.0097)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/hash: 6.35% (0.5040 => 0.5360, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.08% (0.2360 => 0.2480, std.dev.: 0.0037)
  MultiSource/Applications/lemon/lemon: 4.60% (0.9561 => 1.0001, std.dev.: 0.0157)
  MultiSource/Benchmarks/Olden/bisort/bisort: 2.21% (0.7240 => 0.7400, std.dev.: 0.0048)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.12% (2.4922 => 2.4642, std.dev.: 0.0100)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Compile Time
---------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: 0.73% (19.2805 => 19.4206, std.dev.: 0.0461)

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/JM/lencod/lencod: -100.00% (8.1325 => 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2009-12-07-StructReturn: 300.00% (0.0040 => 0.0160, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout/fib2: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0047)
  SingleSource/Regression/C++/EH/function_try_block: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 30.43% (0.0920 => 0.1200, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 22.22% (0.0720 => 0.0880, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 11.11% (0.1080 => 0.1200, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/methcall: 8.93% (0.2240 => 0.2440, std.dev.: 0.0056)
  SingleSource/Benchmarks/McGill/chomp: 8.70% (0.1840 => 0.2000, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 6.67% (0.2400 => 0.2560, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 5.88% (0.7480 => 0.7920, std.dev.: 0.0100)
  SingleSource/UnitTests/Vector/constpool: 5.77% (10.3246 => 10.9207, std.dev.: 0.0925)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.62% (0.3560 => 0.3760, std.dev.: 0.0062)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.25% (1.4480 => 1.5240, std.dev.: 0.0270)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.07% (1.1801 => 1.2281, std.dev.: 0.0080)
  MultiSource/Benchmarks/MallocBench/gs/gs: 3.36% (5.2320 => 5.4080, std.dev.: 0.0517)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.21% (1.1201 => 1.1561, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.09% (1.1641 => 1.2001, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.66% (1.3521 => 1.3881, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.47% (1.1321 => 1.1601, std.dev.: 0.0085)
  MultiSource/Applications/hexxagon/hexxagon: 2.42% (1.1560 => 1.1840, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.29% (1.2201 => 1.2481, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.22% (1.2641 => 1.2921, std.dev.: 0.0106)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.15% (5.5800 => 5.7000, std.dev.: 0.0364)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.93% (11.2203 => 11.4363, std.dev.: 0.0296)
  MultiSource/Applications/SPASS/SPASS: 1.90% (18.5724 => 18.9245, std.dev.: 0.0375)
  MultiSource/Applications/lemon/lemon: 1.89% (1.4801 => 1.5081, std.dev.: 0.0090)
  MultiSource/Applications/sqlite3/sqlite3: 1.88% (24.2975 => 24.7535, std.dev.: 0.0584)
  MultiSource/Benchmarks/Bullet/bullet: 1.87% (38.5246 => 39.2446, std.dev.: 0.0919)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.58% (5.3080 => 5.3920, std.dev.: 0.0286)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.48% (16.5123 => 16.7563, std.dev.: 0.0450)
  MultiSource/Applications/siod/siod: 1.47% (2.7201 => 2.7602, std.dev.: 0.0109)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.44% (48.7489 => 49.4529, std.dev.: 0.0662)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.44% (28.9458 => 29.3618, std.dev.: 0.0621)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.42% (4.2323 => 4.2923, std.dev.: 0.0117)
  MultiSource/Applications/JM/ldecod/ldecod: 1.36% (8.5002 => 8.6162, std.dev.: 0.0319)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 13.64% (0.0880 => 0.1000, std.dev.: 0.0030)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.22% (3.9482 => 3.9962, std.dev.: 0.0129)
  MultiSource/Applications/minisat/minisat: 1.00% (6.7804 => 6.8484, std.dev.: 0.0228)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.11% (97.4941 => 33.0381, std.dev.: 20.9366)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.07% (145.2571 => 49.2871, std.dev.: 30.2449)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.09% (46.2869 => 17.0851, std.dev.: 10.4923)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.61% (3.3282 => 2.3761, std.dev.: 0.1032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -25.43% (38.3664 => 28.6098, std.dev.: 0.6108)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.82% (1.3201 => 1.2961, std.dev.: 0.0062)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.30% (2.4522 => 2.4202, std.dev.: 0.0118)

Report Time: 2.18s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140104/f4e71f12/attachment.html>


More information about the llvm-testresults mailing list