[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 13 06:16:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15258?compare_to=15254&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15258, Order: 190677, Start Time: 2013-09-13 11:27:17, End Time: 2013-09-13 13:19:03
      To: 15254, Order: 190668, Start Time: 2013-09-13 09:07:29, End Time: 2013-09-13 11:01:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 12 (29 on baseline)
Performance Improvements: 85 (7 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1010 (1071 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/cast2: 70.29% (0.0175 => 0.0298, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 69.37% (0.2109 => 0.3572, std.dev.: 0.0161)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 61.31% (0.0199 => 0.0321, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/div: 57.02% (0.0356 => 0.0559, std.dev.: 0.0060)
  MultiSource/Applications/d/make_dparser: 14.34% (3.5888 => 4.1036, std.dev.: 0.1756)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/d/make_dparser: 62.18% (0.0394 => 0.0639, std.dev.: 0.0019)
  MultiSource/Applications/SPASS/SPASS: 18.05% (8.5511 => 10.0947, std.dev.: 0.5421)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.34% (1.2613 => 1.3539, std.dev.: 0.0286)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.55% (2.9451 => 3.1086, std.dev.: 0.0615)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.65% (1.0315 => 1.0692, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.62% (2.4662 => 2.5555, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.35% (1.5942 => 1.6157, std.dev.: 0.0083)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -44.93% (0.0937 => 0.0516, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -42.73% (0.1423 => 0.0815, std.dev.: 0.0070)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -42.48% (0.1728 => 0.0994, std.dev.: 0.0049)
  MultiSource/Benchmarks/Olden/em3d/em3d: -42.26% (0.3339 => 0.1928, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc/fbench: -39.93% (0.1222 => 0.0734, std.dev.: 0.0028)
  MultiSource/Benchmarks/McCat/09-vor/vor: -39.02% (0.5968 => 0.3639, std.dev.: 0.0106)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: -37.70% (0.0374 => 0.0233, std.dev.: 0.0013)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -36.73% (0.1628 => 0.1030, std.dev.: 0.0218)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -32.87% (0.3986 => 0.2676, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -31.74% (0.8321 => 0.5680, std.dev.: 0.0599)
  MultiSource/Benchmarks/McCat/08-main/main: -30.25% (0.4149 => 0.2894, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -30.23% (1.2506 => 0.8725, std.dev.: 0.0930)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -28.96% (1.5474 => 1.0993, std.dev.: 0.0709)
  SingleSource/Benchmarks/Misc/flops-4: -28.45% (0.0457 => 0.0327, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/gs/gs: -27.38% (6.3650 => 4.6222, std.dev.: 0.5028)
  MultiSource/Benchmarks/McCat/05-eks/eks: -26.52% (0.7239 => 0.5319, std.dev.: 0.0230)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -25.94% (0.3550 => 0.2629, std.dev.: 0.0263)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -25.46% (1.5509 => 1.1561, std.dev.: 0.0112)
  MultiSource/Benchmarks/Olden/power/power: -25.35% (0.1921 => 0.1434, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -25.26% (0.9067 => 0.6777, std.dev.: 0.0649)
  MultiSource/Benchmarks/Olden/mst/mst: -24.77% (0.1748 => 0.1315, std.dev.: 0.0036)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.74% (0.1765 => 0.1346, std.dev.: 0.0141)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -23.47% (0.2710 => 0.2074, std.dev.: 0.0165)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -23.07% (0.3689 => 0.2838, std.dev.: 0.0052)
  MultiSource/Applications/lua/lua: -22.87% (5.5620 => 4.2900, std.dev.: 0.0453)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -22.22% (7.0572 => 5.4888, std.dev.: 0.5504)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -20.32% (0.8811 => 0.7021, std.dev.: 0.0204)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -20.14% (0.4394 => 0.3509, std.dev.: 0.0292)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -19.77% (0.2519 => 0.2021, std.dev.: 0.0047)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -17.94% (0.3444 => 0.2826, std.dev.: 0.0234)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -17.64% (1.4254 => 1.1740, std.dev.: 0.0131)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -17.40% (0.3488 => 0.2881, std.dev.: 0.0062)
  MultiSource/Benchmarks/McCat/18-imp/imp: -17.04% (0.4712 => 0.3909, std.dev.: 0.0139)
  SingleSource/Benchmarks/Misc/oourafft: -16.45% (0.2760 => 0.2306, std.dev.: 0.0110)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -15.11% (1.7498 => 1.4854, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -14.48% (1.4646 => 1.2525, std.dev.: 0.0170)
  MultiSource/Applications/sqlite3/sqlite3: -14.22% (19.5126 => 16.7378, std.dev.: 0.8749)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -13.20% (0.2447 => 0.2124, std.dev.: 0.0004)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -12.26% (0.0938 => 0.0823, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -11.75% (0.1166 => 0.1029, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/distray/distray: -11.41% (0.1306 => 0.1157, std.dev.: 0.0052)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.32% (0.1829 => 0.1622, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C/football/football: -11.29% (1.1335 => 1.0055, std.dev.: 0.0438)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -10.87% (0.1941 => 0.1730, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -10.41% (0.3726 => 0.3338, std.dev.: 0.0146)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -10.38% (0.1098 => 0.0984, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -9.96% (1.4826 => 1.3349, std.dev.: 0.0307)
  MultiSource/Applications/minisat/minisat: -9.64% (0.8348 => 0.7543, std.dev.: 0.0168)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -8.93% (0.1635 => 0.1489, std.dev.: 0.0013)
  MultiSource/Benchmarks/PAQ8p/paq8p: -8.89% (2.8342 => 2.5823, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -8.56% (1.4250 => 1.3030, std.dev.: 0.0137)
  MultiSource/Applications/obsequi/Obsequi: -8.43% (1.2698 => 1.1628, std.dev.: 0.0329)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -8.39% (0.2490 => 0.2281, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -7.57% (1.3500 => 1.2478, std.dev.: 0.0302)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -6.82% (0.6975 => 0.6499, std.dev.: 0.0130)
  SingleSource/Benchmarks/Misc/ReedSolomon: -6.77% (0.2350 => 0.2191, std.dev.: 0.0049)
  MultiSource/Benchmarks/sim/sim: -6.64% (0.4009 => 0.3743, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.24% (0.3108 => 0.2914, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.63% (6.9837 => 6.5905, std.dev.: 0.1514)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -99.14% (0.0116 => 0.0001, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/mst/mst: -50.11% (0.2846 => 0.1420, std.dev.: 0.0360)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -49.06% (1.4491 => 0.7382, std.dev.: 0.2569)
  MultiSource/Benchmarks/McCat/09-vor/vor: -44.59% (0.2016 => 0.1117, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -38.26% (0.1602 => 0.0989, std.dev.: 0.0007)
  SingleSource/Benchmarks/Stanford/Towers: -29.48% (0.0407 => 0.0287, std.dev.: 0.0026)
  MultiSource/Applications/minisat/minisat: -28.88% (8.8414 => 6.2882, std.dev.: 0.6134)
  MultiSource/Benchmarks/McCat/08-main/main: -27.49% (0.0993 => 0.0720, std.dev.: 0.0023)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -27.39% (0.0701 => 0.0509)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -24.49% (0.5593 => 0.4223, std.dev.: 0.0330)
  SingleSource/Benchmarks/Shootout-C++/ary: -22.15% (0.0492 => 0.0383, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -17.45% (0.2247 => 0.1855, std.dev.: 0.0018)
  MultiSource/Benchmarks/llubenchmark/llu: -14.44% (2.3615 => 2.0205, std.dev.: 0.0412)
  MultiSource/Applications/obsequi/Obsequi: -12.86% (2.6287 => 2.2906, std.dev.: 0.0362)
  MultiSource/Benchmarks/Olden/tsp/tsp: -10.96% (1.7448 => 1.5535, std.dev.: 0.0718)
  MultiSource/Benchmarks/Olden/bh/bh: -6.46% (2.5388 => 2.3747, std.dev.: 0.0243)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -4.68% (0.9102 => 0.8676, std.dev.: 0.0157)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.38% (2.5958 => 2.5080, std.dev.: 0.0189)
  SingleSource/Benchmarks/Misc-C++/bigfib: -3.25% (0.3476 => 0.3363, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/flops-4: -3.25% (1.7867 => 1.7287, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.79% (5.8678 => 5.7040, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/flops-7: -1.88% (1.7487 => 1.7159, std.dev.: 0.0042)
  SingleSource/Benchmarks/McGill/queens: -1.58% (1.7676 => 1.7396, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/power/power: -1.39% (1.2627 => 1.2451, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.26% (5.0035 => 4.9404, std.dev.: 0.0238)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.15% (47.7083 => 47.1576, std.dev.: 0.1887)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -22.70% (0.1802 => 0.1393, std.dev.: 0.0117)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/cast-bug: 90.35% (0.0114 => 0.0217, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 68.25% (0.2123 => 0.3572, std.dev.: 0.0161)
  SingleSource/UnitTests/SignlessTypes/cast2: 63.74% (0.0182 => 0.0298, std.dev.: 0.0023)
  SingleSource/UnitTests/SignlessTypes/div: 60.63% (0.0348 => 0.0559, std.dev.: 0.0060)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 59.70% (0.0201 => 0.0321, std.dev.: 0.0004)
  MultiSource/Applications/d/make_dparser: 17.37% (3.4962 => 4.1036, std.dev.: 0.1756)
  MultiSource/Applications/SPASS/SPASS: 12.40% (16.1646 => 18.1685, std.dev.: 0.6059)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 10.67% (0.1406 => 0.1556, std.dev.: 0.0023)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.48% (24.6139 => 26.9473, std.dev.: 0.2929)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.32% (6.0284 => 6.5905, std.dev.: 0.1514)
  MultiSource/Benchmarks/nbench/nbench: 2.85% (1.2484 => 1.2840, std.dev.: 0.0023)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/d/make_dparser: 66.41% (0.0384 => 0.0639, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 35.53% (4.5479 => 6.1636, std.dev.: 0.4269)
  MultiSource/Applications/SPASS/SPASS: 22.64% (8.2311 => 10.0947, std.dev.: 0.5421)
  SingleSource/Benchmarks/Shootout/ary3: 22.32% (4.6972 => 5.7458, std.dev.: 0.2051)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.49% (0.1374 => 0.1628, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.34% (40.5588 => 45.9685, std.dev.: 1.0300)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.68% (2.3084 => 2.5318, std.dev.: 0.0680)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.17% (1.2516 => 1.3539, std.dev.: 0.0286)
  MultiSource/Applications/sgefa/sgefa: 8.15% (1.5790 => 1.7077, std.dev.: 0.0308)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.84% (2.9372 => 3.1086, std.dev.: 0.0615)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.21% (3.9856 => 4.1932, std.dev.: 0.0447)
  MultiSource/Applications/obsequi/Obsequi: 4.67% (2.1884 => 2.2906, std.dev.: 0.0362)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 4.65% (20.8247 => 21.7936, std.dev.: 0.0578)
  MultiSource/Applications/siod/siod: 4.25% (3.5310 => 3.6812, std.dev.: 0.0373)
  MultiSource/Benchmarks/Olden/power/power: 2.31% (1.2170 => 1.2451, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout/fib2: 1.94% (3.5966 => 3.6665, std.dev.: 0.0159)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.33% (16.7972 => 17.0202, std.dev.: 0.0417)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -16.27% (57.2347 => 47.9241, std.dev.: 3.3224)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.53% (0.3304 => 0.2923, std.dev.: 0.0026)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.74% (50.0284 => 47.1576, std.dev.: 0.1887)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.68% (2.4471 => 2.3814, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.71% (17.1431 => 16.8499, std.dev.: 0.0448)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.44% (2.5938 => 2.5564, std.dev.: 0.0126)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.33% (89.7126 => 88.5192, std.dev.: 0.2836)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.34% (0.1348 => 0.1393, std.dev.: 0.0117)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130913/499adbe8/attachment.html>


More information about the llvm-testresults mailing list