[llvm-testresults] pollyperf-O3-polly-scev__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jan 29 20:12:06 PST 2014


http://llvm.org/perf/db_default/v4/nts/21511?compare_to=21467&baseline=21467
Nickname: pollyperf-O3-polly-scev__clang_DEV__x86_64:38

Comparing:
     Run: 21511, Order: 200427, Start Time: 2014-01-29 23:30:22, End Time: 2014-01-30 04:17:13
      To: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53
Baseline: 21467, Order: 200360, Start Time: 2014-01-29 01:08:33, End Time: 2014-01-29 06:14:53

===============
Tests Summary
===============

New Passes: 9 (9 on baseline)
Performance Regressions: 6 (6 on baseline)
Performance Improvements: 5 (5 on baseline)
Existing Failures: 2 (2 on baseline)
Unchanged Tests: 1088 (1088 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

New Passes - Compile Time
-------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  MultiSource/Applications/ClamAV/clamscan: 8.33% (17.6723 => 19.1444, std.dev.: 0.0670)
  MultiSource/Applications/sqlite3/sqlite3: 1408.01% (1.7001 => 25.6376, std.dev.: 0.0574)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -0.30% (50.1010 => 49.9490, std.dev.: 0.0737)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.66% (1.0520 => 1.0240, std.dev.: 0.0227)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (11.3920 => 11.6280, std.dev.: 0.0731)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0064)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9722, std.dev.: 0.0170)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3801, std.dev.: 0.0095)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040)
  SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.58% (0.3040 => 0.3240, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (1.6960 => 1.7640, std.dev.: 0.0123)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (6.1484 => 6.0804, std.dev.: 0.0247)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -38.98% (94.8339 => 57.8636, std.dev.: 5.3063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.72% (49.9431 => 33.1021, std.dev.: 0.2486)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -32.62% (25.7136 => 17.3251, std.dev.: 0.2442)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.97% (3.0722 => 2.6122, std.dev.: 0.1186)

Existing Failures - Compile Time
--------------------------------
  SingleSource/Benchmarks/Misc/oourafft
  SingleSource/Benchmarks/Misc/oourafft: -0.14% (11.3407 => 11.3247, std.dev.: 0.0444)

Existing Failures - Execution Time
----------------------------------
  SingleSource/Benchmarks/Misc/oourafft
  SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Compile Time
-------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/7zip/7zip-benchmark
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  MultiSource/Applications/ClamAV/clamscan: 8.33% (17.6723 => 19.1444, std.dev.: 0.0670)
  MultiSource/Applications/sqlite3/sqlite3: 1408.01% (1.7001 => 25.6376, std.dev.: 0.0574)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -0.30% (50.1010 => 49.9490, std.dev.: 0.0737)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.66% (1.0520 => 1.0240, std.dev.: 0.0227)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.07% (11.3920 => 11.6280, std.dev.: 0.0731)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
  MultiSource/Applications/ClamAV/clamscan: - (0.0000 => 0.1080, std.dev.: 0.0064)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 3.9722, std.dev.: 0.0170)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: - (0.0000 => 1.3801, std.dev.: 0.0095)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: - (0.0000 => 0.0000)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/throw_rethrow_test: 100.00% (0.0120 => 0.0240, std.dev.: 0.0040)
  SingleSource/Regression/C/PR640: 60.00% (0.0200 => 0.0320, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.00% (0.0800 => 0.0920, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 6.58% (0.3040 => 0.3240, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 4.01% (1.6960 => 1.7640, std.dev.: 0.0123)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 1.12% (1.0681 => 1.0801, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.11% (6.1484 => 6.0804, std.dev.: 0.0247)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -38.98% (94.8339 => 57.8636, std.dev.: 5.3063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -33.72% (49.9431 => 33.1021, std.dev.: 0.2486)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -32.62% (25.7136 => 17.3251, std.dev.: 0.2442)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.97% (3.0722 => 2.6122, std.dev.: 0.1186)

Existing Failures - Compile Time
--------------------------------
  SingleSource/Benchmarks/Misc/oourafft
  SingleSource/Benchmarks/Misc/oourafft: -0.14% (11.3407 => 11.3247, std.dev.: 0.0444)

Existing Failures - Execution Time
----------------------------------
  SingleSource/Benchmarks/Misc/oourafft
  SingleSource/Benchmarks/Misc/oourafft: - (0.0000 => 0.0000)

Report Time: 0.50s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140129/4c33955f/attachment.html>


More information about the llvm-testresults mailing list