[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 16 05:21:08 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16368?compare_to=16364&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16368, Order: 192778, Start Time: 2013-10-16 10:31:53, End Time: 2013-10-16 12:24:19
      To: 16364, Order: 192773, Start Time: 2013-10-16 08:15:00, End Time: 2013-10-16 10:03:03
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (35 on baseline)
Performance Improvements: 4 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1077 (1054 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 43.02% (0.0523 => 0.0748, std.dev.: 0.0065)
  MultiSource/Applications/hbd/hbd: 28.54% (1.6015 => 2.0585, std.dev.: 0.1705)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 20.95% (1.4355 => 1.7362, std.dev.: 0.0448)
  MultiSource/Applications/ClamAV/clamscan: 20.53% (16.8840 => 20.3504, std.dev.: 0.8435)
  MultiSource/Applications/lemon/lemon: 17.12% (1.2319 => 1.4428, std.dev.: 0.0573)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.50% (7.4201 => 8.4216, std.dev.: 0.3372)
  MultiSource/Applications/minisat/minisat: 8.59% (0.7604 => 0.8257, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.14% (1.2367 => 1.2632, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.06% (1.2778 => 1.3041, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/lemon/lemon: 43.22% (0.8506 => 1.2182, std.dev.: 0.0702)
  MultiSource/Applications/minisat/minisat: 26.61% (6.3446 => 8.0330, std.dev.: 0.5328)
  MultiSource/Applications/SPASS/SPASS: 24.57% (8.0390 => 10.0142, std.dev.: 0.4614)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.95% (35.7817 => 41.4885, std.dev.: 0.6065)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.99% (4.9541 => 5.4490, std.dev.: 0.0145)
  MultiSource/Applications/JM/lencod/lencod: 7.27% (7.5647 => 8.1144, std.dev.: 0.1235)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.46% (4.0192 => 4.2787, std.dev.: 0.0486)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.34% (3.6366 => 3.8671, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 5.77% (2.5002 => 2.6445, std.dev.: 0.0288)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.69% (4.1015 => 4.2937, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.88% (5.8949 => 6.1238, std.dev.: 0.0774)
  SingleSource/Regression/C/uint64_to_float: 3.77% (1.4305 => 1.4844, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.04% (1.0364 => 1.0679, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/fp-convert: 2.46% (7.5763 => 7.7628, std.dev.: 0.0187)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.29% (3.5732 => 3.6552, std.dev.: 0.0194)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.02% (4.1912 => 4.2759, std.dev.: 0.0187)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.10% (3.1140 => 3.1481, std.dev.: 0.0127)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.67% (10.4464 => 10.2721, std.dev.: 0.0305)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/aha/aha: -5.17% (3.7779 => 3.5826, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.39% (3.7081 => 3.5452, std.dev.: 0.0615)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.33% (12.6647 => 12.4962, std.dev.: 0.0632)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 6.98% (0.1347 => 0.1441, std.dev.: 0.0232)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 48.41% (0.0504 => 0.0748, std.dev.: 0.0065)
  MultiSource/Applications/hbd/hbd: 31.15% (1.5696 => 2.0585, std.dev.: 0.1705)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.65% (1.4041 => 1.7362, std.dev.: 0.0448)
  MultiSource/Applications/ClamAV/clamscan: 23.04% (16.5398 => 20.3504, std.dev.: 0.8435)
  MultiSource/Applications/lemon/lemon: 21.63% (1.1862 => 1.4428, std.dev.: 0.0573)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 15.90% (7.2661 => 8.4216, std.dev.: 0.3372)
  MultiSource/Applications/hexxagon/hexxagon: 15.33% (1.0276 => 1.1851, std.dev.: 0.0541)
  MultiSource/Applications/oggenc/oggenc: 13.23% (5.3339 => 6.0396, std.dev.: 0.2550)
  MultiSource/Applications/minisat/minisat: 11.00% (0.7439 => 0.8257, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.01% (1.2660 => 1.3041, std.dev.: 0.0043)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.82% (9.9903 => 10.2721, std.dev.: 0.0305)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.51% (7.6426 => 12.4962, std.dev.: 0.0632)
  MultiSource/Applications/lemon/lemon: 42.88% (0.8526 => 1.2182, std.dev.: 0.0702)
  MultiSource/Applications/minisat/minisat: 28.00% (6.2760 => 8.0330, std.dev.: 0.5328)
  MultiSource/Applications/SPASS/SPASS: 21.66% (8.2311 => 10.0142, std.dev.: 0.4614)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.76% (1.1431 => 1.3804, std.dev.: 0.0613)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.61% (36.8417 => 41.4885, std.dev.: 0.6065)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.24% (4.9428 => 5.4490, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.78% (3.5550 => 3.8671, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.35% (3.9856 => 4.2787, std.dev.: 0.0486)
  SingleSource/UnitTests/Vector/multiplies: 6.73% (0.5561 => 0.5935, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.43% (3.1730 => 3.3452, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.70% (4.1011 => 4.2937, std.dev.: 0.0154)
  MultiSource/Benchmarks/sim/sim: 3.93% (3.8312 => 3.9818, std.dev.: 0.0473)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.69% (5.9061 => 6.1238, std.dev.: 0.0774)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.65% (2.5513 => 2.6445, std.dev.: 0.0288)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.64% (89.7126 => 92.9795, std.dev.: 0.3133)
  MultiSource/Applications/hexxagon/hexxagon: 3.24% (14.7810 => 15.2601, std.dev.: 0.0815)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.44% (3.5683 => 3.6552, std.dev.: 0.0194)
  SingleSource/Benchmarks/Misc/fp-convert: 2.31% (7.5877 => 7.7628, std.dev.: 0.0187)
  MultiSource/Benchmarks/Olden/power/power: 2.21% (1.2170 => 1.2439, std.dev.: 0.0100)
  SingleSource/Regression/C/uint64_to_float: 2.18% (1.4528 => 1.4844, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.61% (11.7654 => 11.9549, std.dev.: 0.0594)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.57% (16.7972 => 17.0607, std.dev.: 0.0195)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.15% (8.1346 => 8.2285, std.dev.: 0.0309)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.65% (0.1483 => 0.1162, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.99% (0.5226 => 0.2352, std.dev.: 0.0837)
  MultiSource/Applications/sgefa/sgefa: -43.25% (1.5790 => 0.8961, std.dev.: 0.0104)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.50% (0.0400 => 0.0278, std.dev.: 0.0036)
  MultiSource/Benchmarks/Olden/em3d/em3d: -28.90% (5.0288 => 3.5753, std.dev.: 0.0857)
  SingleSource/Benchmarks/Linpack/linpack-pc: -19.71% (57.2347 => 45.9523, std.dev.: 3.3579)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.56% (15.9508 => 13.1493, std.dev.: 0.2776)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.3304 => 0.2904, std.dev.: 0.0035)
  MultiSource/Benchmarks/mafft/pairlocalalign: -12.06% (50.0284 => 43.9968, std.dev.: 1.1865)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.59% (20.8247 => 18.4109, std.dev.: 0.2010)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.94% (3.4956 => 3.1481, std.dev.: 0.0127)
  MultiSource/Benchmarks/nbench/nbench: -8.59% (22.1263 => 20.2261, std.dev.: 0.7033)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.47% (30.1838 => 28.5326, std.dev.: 0.5865)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.78% (3.7437 => 3.6397, std.dev.: 0.0268)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.52% (3.7874 => 3.6921, std.dev.: 0.0027)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.16% (2.4471 => 2.3943, std.dev.: 0.0151)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.91% (4.3592 => 4.2759, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.90% (17.1431 => 16.8166, std.dev.: 0.1041)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 6.90% (0.1348 => 0.1441, std.dev.: 0.0232)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131016/a5859399/attachment.html>


More information about the llvm-testresults mailing list