[llvm-testresults] pollyperf4__pollyperf-O3__clang_DEV__x86_64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Dec 28 10:11:48 PST 2013


http://llvm.org/perf/db_default/v4/nts/19182?compare_to=19165&baseline=18565
Nickname: pollyperf4__pollyperf-O3__clang_DEV__x86_64:24

Comparing:
     Run: 19182, Order: 198114, Start Time: 2013-12-28 13:30:49, End Time: 2013-12-28 18:16:15
      To: 19165, Order: 198095, Start Time: 2013-12-28 03:36:23, End Time: 2013-12-28 08:22:31
Baseline: 18565, Order: 197552, Start Time: 2013-12-18 08:27:56, End Time: 2013-12-18 13:39:39

===============
Tests Summary
===============

Performance Regressions: 19 (21 on baseline)
Performance Improvements: 3 (9 on baseline)
Unchanged Tests: 1088 (1080 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/cast2: 400.00% (0.0040 => 0.0200, std.dev.: 0.0045)
  SingleSource/Regression/C++/EH/simple_rethrow: 100.00% (0.0120 => 0.0240, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/hash: 30.77% (0.0520 => 0.0680, std.dev.: 0.0036)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 23.08% (0.0520 => 0.0640, std.dev.: 0.0033)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 22.22% (0.0720 => 0.0880, std.dev.: 0.0044)
  MultiSource/Benchmarks/NPB-serial/is/is: 18.75% (0.0640 => 0.0760, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 15.00% (0.0800 => 0.0920, std.dev.: 0.0032)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 14.29% (0.1120 => 0.1280, std.dev.: 0.0049)
  SingleSource/UnitTests/Vector/SSE/sse_stepfft: 11.11% (0.1080 => 0.1200, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 10.34% (0.3480 => 0.3840, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 8.70% (0.1840 => 0.2000, std.dev.: 0.0051)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.11% (0.1480 => 0.1600, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 4.50% (0.4440 => 0.4640, std.dev.: 0.0077)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.58% (0.7760 => 0.7960, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.14% (1.1241 => 1.1481, std.dev.: 0.0080)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 8.62% (0.2320 => 0.2520, std.dev.: 0.0039)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 3.21% (0.7480 => 0.7720, std.dev.: 0.0087)
  MultiSource/Applications/sgefa/sgefa: 2.33% (0.5160 => 0.5280, std.dev.: 0.0016)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/DefaultInitDynArrays: -75.00% (0.0160 => 0.0040, std.dev.: 0.0045)
  SingleSource/Regression/C/sumarray2d: -55.56% (0.0360 => 0.0160, std.dev.: 0.0076)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.07% (8.1121 => 7.9441, std.dev.: 0.0554)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/ConstructorDestructorAttributes: 150.00% (0.0080 => 0.0200, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/simple: 100.00% (0.0120 => 0.0240, std.dev.: 0.0032)
  SingleSource/Benchmarks/Stanford/Bubblesort: 66.67% (0.0240 => 0.0400, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/flops-8: 42.86% (0.0280 => 0.0400, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/random: 42.86% (0.0280 => 0.0400, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 40.00% (0.0600 => 0.0840, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 25.00% (0.0480 => 0.0600, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/hash: 21.43% (0.0560 => 0.0680, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 20.00% (0.0800 => 0.0960, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.29% (0.0840 => 0.0960, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 9.33% (0.3000 => 0.3280, std.dev.: 0.0092)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 8.11% (0.1480 => 0.1600, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 7.35% (0.2720 => 0.2920, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/wc: 6.45% (0.2480 => 0.2640, std.dev.: 0.0057)
  SingleSource/UnitTests/Vector/constpool: 6.08% (10.3966 => 11.0287, std.dev.: 0.1424)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.70% (1.1761 => 1.1961, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.68% (1.1921 => 1.2121, std.dev.: 0.0059)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 6.63% (0.7240 => 0.7720, std.dev.: 0.0087)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 6.52% (0.1840 => 0.1960, std.dev.: 0.0018)
  MultiSource/Applications/sgefa/sgefa: 2.33% (0.5160 => 0.5280, std.dev.: 0.0016)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.31% (3.9602 => 4.0122, std.dev.: 0.0105)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -26.32% (0.0760 => 0.0560, std.dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -63.32% (90.4297 => 33.1741, std.dev.: 20.7547)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -63.02% (46.3269 => 17.1331, std.dev.: 10.4225)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -60.79% (125.5798 => 49.2391, std.dev.: 29.2717)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -40.00% (0.0400 => 0.0240, std.dev.: 0.0062)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -26.28% (3.2122 => 2.3681, std.dev.: 0.1106)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.15% (37.8384 => 29.4578, std.dev.: 0.5739)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.36% (1.1761 => 1.1601, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout/ary3: -1.01% (3.5642 => 3.5282, std.dev.: 0.0093)

Report Time: 4.11s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131228/f6427a27/attachment.html>


More information about the llvm-testresults mailing list