[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Dec 28 22:02:50 PST 2013


http://llvm.org/perf/db_default/v4/nts/19229?compare_to=19218&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19229, Order: 198146, Start Time: 2013-12-29 04:18:26, End Time: 2013-12-29 06:07:25
      To: 19218, Order: 198144, Start Time: 2013-12-29 02:12:53, End Time: 2013-12-29 03:55:55
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 36 (37 on baseline)
Performance Improvements: 7 (8 on baseline)
Unchanged Tests: 1067 (1065 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/d/make_dparser: 12.19% (3.5585 => 3.9924, std.dev.: 0.1608)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 10.89% (0.1139 => 0.1263, std.dev.: 0.0031)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.05% (44.5874 => 49.0682, std.dev.: 1.4297)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.31% (27.5738 => 30.1406, std.dev.: 0.6302)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.22% (2.7614 => 3.0160, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.17% (5.4633 => 5.9095, std.dev.: 0.1724)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.06% (1.2609 => 1.3625, std.dev.: 0.0364)
  SingleSource/Benchmarks/Shootout-C++/objinst: 5.21% (0.2112 => 0.2222, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.91% (1.2961 => 1.3597, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.16% (0.3826 => 0.3985, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.15% (1.3455 => 1.4014, std.dev.: 0.0200)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.81% (0.5169 => 0.5314, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 49.99% (2.8321 => 4.2480, std.dev.: 0.1048)
  SingleSource/Benchmarks/Shootout/ary3: 35.88% (4.2115 => 5.7227, std.dev.: 0.1704)
  SingleSource/Benchmarks/Shootout-C++/ary3: 27.76% (4.5169 => 5.7710, std.dev.: 0.1356)
  SingleSource/Benchmarks/Shootout/heapsort: 18.03% (3.1012 => 3.6605, std.dev.: 0.1876)
  SingleSource/Benchmarks/Shootout-C++/moments: 16.84% (0.1045 => 0.1221, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 15.54% (3.9648 => 4.5811, std.dev.: 0.1405)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.37% (9.2516 => 10.6733, std.dev.: 0.0288)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.93% (2.1029 => 2.3748, std.dev.: 0.0146)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.86% (2.6678 => 2.9041, std.dev.: 0.0082)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.26% (2.2833 => 2.4720, std.dev.: 0.0261)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.75% (14.8365 => 15.9861, std.dev.: 0.0913)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.47% (5.0272 => 5.4029, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/lists: 4.95% (7.0324 => 7.3807, std.dev.: 0.0609)
  SingleSource/Benchmarks/Misc/salsa20: 4.88% (7.5577 => 7.9264, std.dev.: 0.1067)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.27% (0.6344 => 0.6615, std.dev.: 0.0017)
  MultiSource/Applications/hexxagon/hexxagon: 4.05% (14.9754 => 15.5825, std.dev.: 0.0191)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.78% (40.5584 => 42.0930, std.dev.: 0.5131)
  SingleSource/Benchmarks/Misc/flops: 3.73% (9.2636 => 9.6087, std.dev.: 0.0207)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.31% (39.2154 => 40.5119, std.dev.: 0.0552)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.28% (5.1400 => 5.3086, std.dev.: 0.0632)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.07% (5.0920 => 5.1974, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/oourafft: 1.47% (3.6576 => 3.7114, std.dev.: 0.0066)
  MultiSource/Applications/sqlite3/sqlite3: 1.46% (4.1540 => 4.2147, std.dev.: 0.0176)
  SingleSource/Benchmarks/Shootout/random: 1.05% (2.4493 => 2.4749, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -16.12% (23.6598 => 19.8451, std.dev.: 1.3315)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -11.67% (7.2002 => 6.3600, std.dev.: 0.1781)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.50% (1.5016 => 1.3739, std.dev.: 0.0367)
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.59% (3.0668 => 2.8646, std.dev.: 0.0258)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.64% (2.0961 => 1.9779, std.dev.: 0.0267)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.04% (52.1446 => 50.5620, std.dev.: 0.3989)
  SingleSource/Benchmarks/Misc/fp-convert: -2.14% (7.6828 => 7.5185, std.dev.: 0.0501)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.77% (15.7419 => 22.1605, std.dev.: 1.4510)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.08% (25.9661 => 30.1406, std.dev.: 0.6302)
  MultiSource/Applications/lemon/lemon: 9.75% (1.2200 => 1.3390, std.dev.: 0.0423)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.39% (2.7572 => 3.0160, std.dev.: 0.0031)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.24% (44.9186 => 49.0682, std.dev.: 1.4297)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.85% (1.2845 => 1.3597, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout-C++/objinst: 4.96% (0.2117 => 0.2222, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.18% (0.3825 => 0.3985, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 3.91% (0.3758 => 0.3905, std.dev.: 0.0049)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.51% (0.5134 => 0.5314, std.dev.: 0.0026)
  MultiSource/Applications/minisat/minisat: 2.30% (0.7533 => 0.7706, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 41.86% (2.9945 => 4.2480, std.dev.: 0.1048)
  SingleSource/Benchmarks/Shootout/ary3: 24.47% (4.5977 => 5.7227, std.dev.: 0.1704)
  SingleSource/Benchmarks/Shootout/heapsort: 24.12% (2.9492 => 3.6605, std.dev.: 0.1876)
  SingleSource/Benchmarks/Shootout-C++/ary3: 23.32% (4.6797 => 5.7710, std.dev.: 0.1356)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 17.82% (3.8883 => 4.5811, std.dev.: 0.1405)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.83% (5.9583 => 6.9608, std.dev.: 0.3191)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.98% (2.1020 => 2.3748, std.dev.: 0.0146)
  SingleSource/Benchmarks/Shootout-C++/moments: 9.41% (0.1116 => 0.1221, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.94% (2.6658 => 2.9041, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.37% (5.0320 => 5.4029, std.dev.: 0.0041)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.50% (10.0217 => 10.6733, std.dev.: 0.0288)
  MultiSource/Applications/siod/siod: 6.12% (3.4258 => 3.6354, std.dev.: 0.0213)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.84% (2.3355 => 2.4720, std.dev.: 0.0261)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.65% (0.6261 => 0.6615, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/lists: 5.54% (6.9930 => 7.3807, std.dev.: 0.0609)
  SingleSource/Benchmarks/Misc/salsa20: 4.37% (7.5947 => 7.9264, std.dev.: 0.1067)
  MultiSource/Applications/hexxagon/hexxagon: 3.89% (14.9989 => 15.5825, std.dev.: 0.0191)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.80% (40.5530 => 42.0930, std.dev.: 0.5131)
  SingleSource/Benchmarks/Misc/flops: 3.68% (9.2673 => 9.6087, std.dev.: 0.0207)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (15.5356 => 15.9861, std.dev.: 0.0913)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.14% (4.4509 => 4.5460, std.dev.: 0.0365)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.10% (5.4994 => 5.6149, std.dev.: 0.0400)
  SingleSource/Benchmarks/Misc/fp-convert: 1.75% (7.3892 => 7.5185, std.dev.: 0.0501)
  SingleSource/Benchmarks/Misc/oourafft: 1.68% (3.6501 => 3.7114, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.58% (11.7894 => 11.9756, std.dev.: 0.0380)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.58% (1.5797 => 1.6046, std.dev.: 0.0053)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.16% (0.0688 => 0.0508, std.dev.: 0.0008)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.56% (0.2824 => 0.2667, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.16% (1.1409 => 1.0820, std.dev.: 0.0217)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.71% (0.2758 => 0.2628, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.45% (2.8850 => 2.3817, std.dev.: 0.0922)
  MultiSource/Benchmarks/nbench/nbench: -15.44% (23.4696 => 19.8451, std.dev.: 1.3315)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.49% (6.0535 => 5.9029, std.dev.: 0.0400)
  MultiSource/Applications/sqlite3/sqlite3: -1.93% (4.2978 => 4.2147, std.dev.: 0.0176)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131229/f87ef479/attachment.html>


More information about the llvm-testresults mailing list