[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 18 18:36:50 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16461?compare_to=16456&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16461, Order: 193009, Start Time: 2013-10-18 23:45:34, End Time: 2013-10-19 01:40:04
      To: 16456, Order: 192997, Start Time: 2013-10-18 21:06:14, End Time: 2013-10-18 22:55:39
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 35 (50 on baseline)
Performance Improvements: 1 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1071 (1042 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/spiff/spiff: 59.51% (0.9040 => 1.4420, std.dev.: 0.0675)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 49.73% (0.0915 => 0.1370, std.dev.: 0.0170)
  SingleSource/UnitTests/Vector/constpool: 45.62% (8.8893 => 12.9445, std.dev.: 1.3102)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 31.64% (1.1587 => 1.5253, std.dev.: 0.1421)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.31% (1.4108 => 1.7256, std.dev.: 0.1116)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.81% (7.6023 => 9.1846, std.dev.: 0.3225)
  MultiSource/Applications/d/make_dparser: 18.91% (3.6434 => 4.3323, std.dev.: 0.0665)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.54% (1.9044 => 2.2384, std.dev.: 0.0596)
  MultiSource/Applications/siod/siod: 15.31% (2.5454 => 2.9351, std.dev.: 0.0587)
  MultiSource/Benchmarks/Olden/power/power: 13.55% (0.1410 => 0.1601, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 12.49% (1.3269 => 1.4926, std.dev.: 0.0383)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.71% (14.8312 => 16.5683, std.dev.: 0.5016)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 11.06% (1.5022 => 1.6683, std.dev.: 0.0410)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.88% (1.2346 => 1.3566, std.dev.: 0.0386)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.12% (1.2364 => 1.3492, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.26% (1.2197 => 1.3083, std.dev.: 0.0274)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 59.40% (0.0463 => 0.0738, std.dev.: 0.0038)
  MultiSource/Applications/d/make_dparser: 57.91% (0.0373 => 0.0589, std.dev.: 0.0027)
  MultiSource/Applications/minisat/minisat: 44.79% (6.3694 => 9.2224, std.dev.: 0.0630)
  MultiSource/Benchmarks/Olden/bisort/bisort: 33.10% (0.6731 => 0.8959, std.dev.: 0.0808)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.26% (2.5170 => 3.2786, std.dev.: 0.0858)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.46% (28.8498 => 34.1743, std.dev.: 0.9896)
  SingleSource/Benchmarks/Shootout/sieve: 15.79% (7.0451 => 8.1576, std.dev.: 0.2515)
  SingleSource/Benchmarks/Linpack/linpack-pc: 14.92% (44.5862 => 51.2364, std.dev.: 1.2175)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.72% (1.3126 => 1.4927, std.dev.: 0.0688)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.24% (40.7961 => 44.5660, std.dev.: 1.2748)
  SingleSource/Benchmarks/Misc/salsa20: 8.19% (7.5407 => 8.1586, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.07% (4.1008 => 4.3497, std.dev.: 0.0207)
  MultiSource/Applications/lua/lua: 2.85% (28.9290 => 29.7536, std.dev.: 0.3035)
  SingleSource/Benchmarks/Misc/flops: 2.76% (9.2725 => 9.5287, std.dev.: 0.0575)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.45% (5.7046 => 5.8444, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.10% (4.2230 => 4.3117, std.dev.: 0.0247)
  MultiSource/Applications/siod/siod: 1.67% (3.5403 => 3.5994, std.dev.: 0.0172)
  MultiSource/Applications/viterbi/viterbi: 1.65% (2.6283 => 2.6717, std.dev.: 0.0144)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.00% (8.8938 => 8.9828, std.dev.: 0.0121)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.29% (8.9071 => 8.5249, std.dev.: 0.1377)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.57% (0.1405 => 0.1397, std.dev.: 0.0316)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/spiff/spiff: 61.82% (0.8911 => 1.4420, std.dev.: 0.0675)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 50.55% (0.0910 => 0.1370, std.dev.: 0.0170)
  SingleSource/UnitTests/Vector/constpool: 45.57% (8.8921 => 12.9445, std.dev.: 1.3102)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 31.72% (1.1580 => 1.5253, std.dev.: 0.1421)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.40% (7.2661 => 9.1846, std.dev.: 0.3225)
  MultiSource/Applications/d/make_dparser: 23.91% (3.4962 => 4.3323, std.dev.: 0.0665)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 22.97% (1.4033 => 1.7256, std.dev.: 0.1116)
  MultiSource/Applications/siod/siod: 19.90% (2.4480 => 2.9351, std.dev.: 0.0587)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 19.22% (1.8775 => 2.2384, std.dev.: 0.0596)
  MultiSource/Benchmarks/NPB-serial/is/is: 16.87% (0.0735 => 0.0859, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 14.98% (1.2981 => 1.4926, std.dev.: 0.0383)
  MultiSource/Benchmarks/Olden/power/power: 14.52% (0.1398 => 0.1601, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.45% (14.4764 => 16.5683, std.dev.: 0.5016)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 12.78% (1.4792 => 1.6683, std.dev.: 0.0410)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 12.25% (1.2086 => 1.3566, std.dev.: 0.0386)
  MultiSource/Applications/kimwitu++/kc: 10.52% (18.3608 => 20.2922, std.dev.: 0.6993)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.96% (1.2007 => 1.3083, std.dev.: 0.0274)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.94% (1.2499 => 1.3492, std.dev.: 0.0077)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.90% (0.1651 => 0.1765, std.dev.: 0.0036)
  MultiSource/Applications/lambda-0_1_3/lambda: 5.22% (0.8014 => 0.8432, std.dev.: 0.0058)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 62.21% (7.6426 => 12.3967, std.dev.: 0.0757)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 59.40% (0.0463 => 0.0738, std.dev.: 0.0038)
  MultiSource/Applications/d/make_dparser: 53.39% (0.0384 => 0.0589, std.dev.: 0.0027)
  MultiSource/Applications/minisat/minisat: 46.95% (6.2760 => 9.2224, std.dev.: 0.0630)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 36.55% (2.4010 => 3.2786, std.dev.: 0.0858)
  MultiSource/Benchmarks/Olden/bisort/bisort: 34.78% (0.6647 => 0.8959, std.dev.: 0.0808)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.22% (2.4753 => 3.0748, std.dev.: 0.1712)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.74% (1.1431 => 1.3916, std.dev.: 0.0556)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.75% (1.3008 => 1.4927, std.dev.: 0.0688)
  SingleSource/Benchmarks/Shootout/matrix: 14.45% (1.7809 => 2.0382, std.dev.: 0.0503)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.22% (30.1838 => 34.1743, std.dev.: 0.9896)
  SingleSource/Benchmarks/Shootout/sieve: 12.90% (7.2254 => 8.1576, std.dev.: 0.2515)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 10.79% (0.8273 => 0.9166, std.dev.: 0.0266)
  SingleSource/UnitTests/Vector/multiplies: 7.03% (0.5561 => 0.5952, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.06% (4.1011 => 4.3497, std.dev.: 0.0207)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 5.75% (2.5368 => 2.6827, std.dev.: 0.0352)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.53% (3.1730 => 3.3486, std.dev.: 0.0550)
  SingleSource/Benchmarks/Misc/salsa20: 4.65% (7.7964 => 8.1586, std.dev.: 0.0411)
  MultiSource/Applications/hexxagon/hexxagon: 4.02% (14.7810 => 15.3751, std.dev.: 0.1797)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (89.7126 => 92.7632, std.dev.: 0.2699)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 3.12% (5.8715 => 6.0549, std.dev.: 0.0525)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.62% (5.6951 => 5.8444, std.dev.: 0.0324)
  MultiSource/Applications/siod/siod: 1.94% (3.5310 => 3.5994, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.71% (4.2391 => 4.3117, std.dev.: 0.0247)
  SingleSource/Benchmarks/Shootout/methcall: 1.58% (8.5434 => 8.6782, std.dev.: 0.0236)
  SingleSource/Benchmarks/Shootout/fib2: 1.53% (3.5966 => 3.6517, std.dev.: 0.0037)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.38% (16.7972 => 17.0287, std.dev.: 0.0383)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.26% (8.1346 => 8.2372, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.25% (5.1005 => 5.1642, std.dev.: 0.0231)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.16% (8.8798 => 8.9828, std.dev.: 0.0121)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.96% (0.5226 => 0.2406, std.dev.: 0.0095)
  MultiSource/Applications/sgefa/sgefa: -43.31% (1.5790 => 0.8951, std.dev.: 0.0090)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.50% (0.0400 => 0.0278, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/em3d/em3d: -28.12% (5.0288 => 3.6147, std.dev.: 0.0915)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.78% (20.8247 => 18.3710, std.dev.: 0.1749)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.92% (50.0284 => 44.5660, std.dev.: 1.2748)
  SingleSource/Benchmarks/Linpack/linpack-pc: -10.48% (57.2347 => 51.2364, std.dev.: 1.2175)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.99% (3.4956 => 3.1465, std.dev.: 0.0185)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.29% (0.7474 => 0.7153, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.17% (5.4473 => 5.2746, std.dev.: 0.0519)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.66% (3.7874 => 3.6866, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.44% (17.1431 => 16.7255, std.dev.: 0.1054)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.17% (4.3592 => 4.2644, std.dev.: 0.0195)
  SingleSource/Benchmarks/Misc/whetstone: -1.16% (3.6303 => 3.5883, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc/flops-5: -1.08% (2.8061 => 2.7757, std.dev.: 0.0116)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.64% (0.1348 => 0.1397, std.dev.: 0.0316)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131018/c6c2159c/attachment.html>


More information about the llvm-testresults mailing list