[llvm-testresults] pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jan 6 16:29:16 PST 2014


http://llvm.org/perf/db_default/v4/nts/19877?compare_to=19856&baseline=18571
Nickname: pollyperf14__pollyperf-O3-polly-detect__clang_DEV__x86_64:28

Comparing:
     Run: 19877, Order: 198625, Start Time: 2014-01-06 19:46:29, End Time: 2014-01-07 00:33:55
      To: 19856, Order: 198607, Start Time: 2014-01-06 14:41:04, End Time: 2014-01-06 19:28:24
Baseline: 18571, Order: 197553, Start Time: 2013-12-18 09:16:57, End Time: 2013-12-18 14:35:04

===============
Tests Summary
===============

Performance Regressions: 16 (38 on baseline)
Performance Improvements: 0 (7 on baseline)
Unchanged Tests: 1094 (1065 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-08-02-CastTest: 200.00% (0.0080 => 0.0240, std.dev.: 0.0026)
  SingleSource/UnitTests/2003-04-22-Switch: 150.00% (0.0080 => 0.0200, std.dev.: 0.0045)
  SingleSource/Regression/C++/BuiltinTypeInfo: 100.00% (0.0120 => 0.0240, std.dev.: 0.0039)
  SingleSource/UnitTests/SignlessTypes/shr: 100.00% (0.0160 => 0.0320, std.dev.: 0.0044)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 60.00% (0.0200 => 0.0320, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 50.00% (0.0320 => 0.0480, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 38.46% (0.0520 => 0.0720, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/mandel: 36.36% (0.0440 => 0.0600, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 20.00% (0.0800 => 0.0960, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 2.70% (1.1841 => 1.2161, std.dev.: 0.0075)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Treesort: 28.57% (0.0560 => 0.0720, std.dev.: 0.0047)
  MultiSource/Applications/ClamAV/clamscan: 24.00% (0.1000 => 0.1240, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 12.00% (0.1000 => 0.1120, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.53% (0.1520 => 0.1680, std.dev.: 0.0044)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.72% (0.5880 => 0.6040, std.dev.: 0.0061)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-05-14-array-init: 150.00% (0.0080 => 0.0200, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/flops-4: 100.00% (0.0200 => 0.0400, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 30.43% (0.0920 => 0.1200, std.dev.: 0.0090)
  SingleSource/Benchmarks/McGill/exptree: 22.73% (0.0880 => 0.1080, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 14.29% (0.0840 => 0.0960, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 11.11% (0.1800 => 0.2000, std.dev.: 0.0074)
  SingleSource/UnitTests/Vector/constpool: 6.90% (10.3246 => 11.0367, std.dev.: 0.1472)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.74% (0.3560 => 0.3800, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 6.12% (0.3920 => 0.4160, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 5.49% (0.3640 => 0.3840, std.dev.: 0.0059)
  MultiSource/Applications/hbd/hbd: 5.40% (1.7040 => 1.7960, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.29% (1.1201 => 1.1681, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.47% (1.1521 => 1.1921, std.dev.: 0.0082)
  MultiSource/Benchmarks/MallocBench/gs/gs: 3.29% (5.2320 => 5.4040, std.dev.: 0.0430)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.05% (1.1801 => 1.2161, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.96% (1.3521 => 1.3921, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.62% (1.2201 => 1.2521, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.47% (1.1321 => 1.1601, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.34% (1.7120 => 1.7520, std.dev.: 0.0127)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.33% (6.7040 => 6.8600, std.dev.: 0.0370)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.33% (2.0640 => 2.1120, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.27% (1.2361 => 1.2641, std.dev.: 0.0063)
  MultiSource/Applications/sqlite3/sqlite3: 2.17% (24.2975 => 24.8255, std.dev.: 0.0497)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.95% (1.2281 => 1.2521, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.79% (16.5123 => 16.8083, std.dev.: 0.0571)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.75% (1.1401 => 1.1601, std.dev.: 0.0077)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.71% (11.2203 => 11.4123, std.dev.: 0.0367)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.62% (5.9164 => 6.0124, std.dev.: 0.0256)
  MultiSource/Applications/lua/lua: 1.60% (4.7560 => 4.8320, std.dev.: 0.0188)
  MultiSource/Applications/SPASS/SPASS: 1.53% (18.5724 => 18.8565, std.dev.: 0.0437)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.52% (28.9458 => 29.3858, std.dev.: 0.0466)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.48% (2.7082 => 2.7482, std.dev.: 0.0100)
  MultiSource/Applications/lemon/lemon: 1.35% (1.4801 => 1.5001, std.dev.: 0.0070)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.30% (9.5162 => 9.6402, std.dev.: 0.0241)
  MultiSource/Applications/JM/lencod/lencod: 1.27% (19.2805 => 19.5246, std.dev.: 0.0848)
  MultiSource/Applications/ClamAV/clamscan: 1.14% (19.0163 => 19.2323, std.dev.: 0.0758)
  MultiSource/Applications/kimwitu++/kc: 1.02% (19.5411 => 19.7411, std.dev.: 0.0412)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 11.11% (0.1080 => 0.1200, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -66.20% (145.2571 => 49.0991, std.dev.: 31.1815)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -66.08% (97.4941 => 33.0741, std.dev.: 21.2486)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.08% (46.2869 => 17.0891, std.dev.: 10.6392)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -28.85% (3.3282 => 2.3681, std.dev.: 0.1100)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -24.37% (38.3664 => 29.0178, std.dev.: 0.5369)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.07% (6.5084 => 6.3084, std.dev.: 0.0693)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.12% (1.3201 => 1.2921, std.dev.: 0.0077)

Report Time: 1.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140106/e6251ec9/attachment.html>


More information about the llvm-testresults mailing list