[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 7 15:56:35 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16081?compare_to=16078&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16081, Order: 192128, Start Time: 2013-10-07 21:05:21, End Time: 2013-10-07 22:59:37
      To: 16078, Order: 192117, Start Time: 2013-10-07 18:45:00, End Time: 2013-10-07 20:41:15
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 12 (30 on baseline)
Performance Improvements: 19 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1076 (1062 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.05% (0.3403 => 0.3813, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/ary2: 7.96% (0.2562 => 0.2766, std.dev.: 0.0060)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 29.33% (3.6299 => 4.6944, std.dev.: 0.1994)
  SingleSource/Benchmarks/McGill/chomp: 17.00% (1.0246 => 1.1988, std.dev.: 0.0428)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.39% (1.1168 => 1.1770, std.dev.: 0.0204)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.75% (0.4424 => 0.4634, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.67% (1.2993 => 1.3470, std.dev.: 0.0060)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.14% (2.5051 => 2.5588, std.dev.: 0.0176)
  MultiSource/Applications/lua/lua: 1.97% (30.5442 => 31.1451, std.dev.: 0.1590)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.71% (4.1369 => 4.2075, std.dev.: 0.0229)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.26% (35.0925 => 35.5349, std.dev.: 0.0382)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.20% (3.7865 => 3.8318, std.dev.: 0.0045)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -43.27% (0.2156 => 0.1223, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -41.26% (0.1333 => 0.0783, std.dev.: 0.0139)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -22.97% (0.0666 => 0.0513, std.dev.: 0.0028)
  MultiSource/Benchmarks/FreeBench/mason/mason: -22.35% (0.0868 => 0.0674, std.dev.: 0.0055)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -18.54% (0.3435 => 0.2798, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -14.16% (0.0897 => 0.0770, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -13.27% (0.1605 => 0.1392, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -13.20% (1.4771 => 1.2821, std.dev.: 0.0525)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.37% (5.2155 => 4.6748, std.dev.: 0.1896)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.42% (0.6276 => 0.5873, std.dev.: 0.0075)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.67% (0.2541 => 0.2397, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -50.33% (0.0304 => 0.0151, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/bisort/bisort: -34.24% (1.0054 => 0.6612, std.dev.: 0.0804)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -18.25% (0.5716 => 0.4673, std.dev.: 0.0203)
  MultiSource/Applications/oggenc/oggenc: -17.34% (0.1966 => 0.1625, std.dev.: 0.0095)
  MultiSource/Benchmarks/Olden/tsp/tsp: -9.07% (1.7402 => 1.5823, std.dev.: 0.0442)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -7.62% (0.3217 => 0.2972, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/mandel: -3.73% (1.0969 => 1.0560, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.50% (3.2493 => 3.2004, std.dev.: 0.0151)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 8.93% (0.1288 => 0.1403, std.dev.: 0.0237)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest: 51.60% (0.0250 => 0.0379, std.dev.: 0.0046)
  MultiSource/Applications/siod/siod: 19.15% (2.4480 => 2.9169, std.dev.: 0.1233)
  MultiSource/Applications/sgefa/sgefa: 18.66% (0.3848 => 0.4566, std.dev.: 0.0217)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.00% (2.6492 => 3.0996, std.dev.: 0.1213)
  MultiSource/Applications/sqlite3/sqlite3: 15.74% (16.2888 => 18.8529, std.dev.: 0.2031)
  MultiSource/Applications/minisat/minisat: 14.72% (0.7439 => 0.8534, std.dev.: 0.0413)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 13.99% (0.3345 => 0.3813, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/ary2: 7.84% (0.2565 => 0.2766, std.dev.: 0.0060)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.22% (7.6426 => 12.5506, std.dev.: 0.0628)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 55.90% (3.0111 => 4.6944, std.dev.: 0.1994)
  MultiSource/Applications/minisat/minisat: 35.55% (6.2760 => 8.5073, std.dev.: 0.6014)
  MultiSource/Applications/obsequi/Obsequi: 21.56% (2.1884 => 2.6602, std.dev.: 0.1260)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.56% (60.7119 => 72.5893, std.dev.: 0.9822)
  SingleSource/Benchmarks/McGill/chomp: 17.98% (1.0161 => 1.1988, std.dev.: 0.0428)
  SingleSource/Benchmarks/Shootout-C++/fibo: 11.20% (4.9428 => 5.4964, std.dev.: 0.1015)
  MultiSource/Applications/lambda-0_1_3/lambda: 8.00% (8.1346 => 8.7852, std.dev.: 0.0755)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.62% (1.2516 => 1.3470, std.dev.: 0.0060)
  SingleSource/UnitTests/Vector/multiplies: 7.35% (0.5561 => 0.5970, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.87% (1.1013 => 1.1770, std.dev.: 0.0204)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.63% (2.3084 => 2.4615, std.dev.: 0.0559)
  MultiSource/Applications/lua/lua: 5.50% (29.5202 => 31.1451, std.dev.: 0.1590)
  MultiSource/Applications/siod/siod: 4.87% (3.5310 => 3.7030, std.dev.: 0.0210)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.57% (0.2842 => 0.2972, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.64% (4.0596 => 4.2075, std.dev.: 0.0229)
  MultiSource/Applications/hexxagon/hexxagon: 2.68% (14.7810 => 15.1768, std.dev.: 0.0265)
  MultiSource/Benchmarks/Olden/power/power: 1.92% (1.2170 => 1.2404, std.dev.: 0.0035)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.78% (16.7972 => 17.0956, std.dev.: 0.0161)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.18% (3.4725 => 3.5135, std.dev.: 0.0150)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.17% (3.7874 => 3.8318, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/methcall: 1.08% (8.5434 => 8.6358, std.dev.: 0.0261)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.36% (0.5226 => 0.2385, std.dev.: 0.0013)
  MultiSource/Applications/sgefa/sgefa: -42.41% (1.5790 => 0.9094, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.25% (0.0400 => 0.0271, std.dev.: 0.0037)
  SingleSource/Benchmarks/Linpack/linpack-pc: -21.32% (57.2347 => 45.0346, std.dev.: 3.1797)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.57% (15.9508 => 13.3077, std.dev.: 0.2291)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.99% (0.3304 => 0.2908, std.dev.: 0.0063)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.65% (20.8247 => 18.3994, std.dev.: 0.0785)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.94% (3.4956 => 3.1483, std.dev.: 0.0384)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (50.0284 => 46.8419, std.dev.: 0.1166)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.75% (3.7437 => 3.5658, std.dev.: 0.0600)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.27% (4.3592 => 4.2168, std.dev.: 0.0425)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.75% (2.4471 => 2.3799, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.43% (17.1431 => 16.7263, std.dev.: 0.0556)
  SingleSource/Benchmarks/Shootout/lists: -1.34% (7.3703 => 7.2713, std.dev.: 0.0342)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.23% (89.7126 => 88.6057, std.dev.: 0.2582)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.08% (0.1348 => 0.1403, std.dev.: 0.0237)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131007/386d7e02/attachment.html>


More information about the llvm-testresults mailing list