[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Sep 12 19:19:21 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15241?compare_to=15238&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15241, Order: 190646, Start Time: 2013-09-13 00:33:34, End Time: 2013-09-13 02:21:53
      To: 15238, Order: 190632, Start Time: 2013-09-12 22:16:09, End Time: 2013-09-13 00:07:35
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 11 (17 on baseline)
Performance Improvements: 57 (12 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1039 (1078 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 35.93% (1.6656 => 2.2641, std.dev.: 0.1614)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 33.31% (0.1480 => 0.1973, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/matrix: 16.42% (1.8114 => 2.1089, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.00% (0.6946 => 0.7293, std.dev.: 0.0001)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.38% (5.4018 => 5.6383, std.dev.: 0.0128)
  SingleSource/Benchmarks/Shootout/methcall: 3.04% (8.3838 => 8.6383, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.52% (4.5027 => 4.6162, std.dev.: 0.0113)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.05% (21.7169 => 22.1626, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.80% (6.5591 => 6.6771, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.54% (1.0491 => 1.0653, std.dev.: 0.0005)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.15% (2.3988 => 2.4265, std.dev.: 0.0061)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/McGill/exptree: -45.18% (0.1713 => 0.0939, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/fp-convert: -44.34% (0.0548 => 0.0305, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/flops-8: -44.22% (0.0545 => 0.0304, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/hello: -41.04% (0.3036 => 0.1790, std.dev.: 0.0222)
  SingleSource/Benchmarks/Shootout/ary3: -40.56% (0.0535 => 0.0318, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/ackermann: -39.30% (0.0374 => 0.0227, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/fbench: -36.40% (0.1121 => 0.0713, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/flops-3: -34.17% (0.0439 => 0.0289, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Perm: -28.82% (0.0458 => 0.0326, std.dev.: 0.0008)
  SingleSource/Benchmarks/Stanford/Queens: -25.67% (0.0596 => 0.0443, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/matrix: -24.17% (0.1084 => 0.0822, std.dev.: 0.0011)
  SingleSource/Benchmarks/Stanford/Oscar: -21.46% (0.0890 => 0.0699, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/ary3: -20.77% (0.3178 => 0.2518, std.dev.: 0.0056)
  SingleSource/Benchmarks/Stanford/Treesort: -19.49% (0.0554 => 0.0446, std.dev.: 0.0011)
  SingleSource/Benchmarks/Stanford/RealMM: -19.03% (0.0557 => 0.0451, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/lists: -17.77% (0.3145 => 0.2586, std.dev.: 0.0140)
  SingleSource/Benchmarks/McGill/queens: -17.68% (0.0639 => 0.0526, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -16.54% (0.0949 => 0.0792, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/hash2: -13.50% (0.5008 => 0.4332, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -12.84% (0.1464 => 0.1276, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -12.73% (0.3834 => 0.3346, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -12.27% (0.0831 => 0.0729, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/methcall: -12.02% (0.2330 => 0.2050, std.dev.: 0.0023)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -10.69% (4.6515 => 4.1543, std.dev.: 0.1921)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -10.48% (0.2108 => 0.1887, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.93% (0.4451 => 0.4009, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -9.88% (0.1063 => 0.0958, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -9.84% (0.2164 => 0.1951, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/lists1: -9.84% (0.3446 => 0.3107, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout-C++/strcat: -9.79% (0.2248 => 0.2028, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -9.68% (0.2303 => 0.2080, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -9.49% (0.2223 => 0.2012, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -9.30% (0.4171 => 0.3783, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/flops: -8.92% (0.1188 => 0.1082, std.dev.: 0.0010)
  SingleSource/Benchmarks/McGill/chomp: -8.73% (0.2416 => 0.2205, std.dev.: 0.0020)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.73% (0.1386 => 0.1265, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/objinst: -7.30% (0.2288 => 0.2121, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.34% (1.2346 => 1.2057, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.90% (1.3419 => 1.3164, std.dev.: 0.0096)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: -45.02% (0.0231 => 0.0127, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -37.32% (4.8227 => 3.0231, std.dev.: 0.4183)
  SingleSource/Benchmarks/Stanford/Towers: -34.32% (0.0338 => 0.0222, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -22.98% (0.1784 => 0.1374, std.dev.: 0.0143)
  SingleSource/Benchmarks/Shootout-C++/strcat: -15.68% (0.1129 => 0.0952, std.dev.: 0.0002)
  SingleSource/Benchmarks/McGill/chomp: -12.16% (1.1597 => 1.0187, std.dev.: 0.0071)
  SingleSource/Benchmarks/McGill/misr: -9.62% (0.4387 => 0.3965, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -9.39% (0.3686 => 0.3340, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -9.16% (0.5031 => 0.4570, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/methcall: -5.93% (8.1314 => 7.6492, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.62% (3.8523 => 3.6359, std.dev.: 0.0390)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.44% (4.2293 => 3.9992, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.89% (2.8069 => 2.6696, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -3.96% (1.5743 => 1.5119, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -3.26% (4.2366 => 4.0986, std.dev.: 0.0344)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.78% (0.7651 => 0.7438, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.83% (3.0099 => 2.9548, std.dev.: 0.0194)
  SingleSource/Benchmarks/Misc/flops-8: -1.22% (2.5614 => 2.5301, std.dev.: 0.0030)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.44% (0.1356 => 0.1350, std.dev.: 0.0395)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 36.61% (1.6574 => 2.2641, std.dev.: 0.1614)
  SingleSource/Benchmarks/Shootout/matrix: 18.42% (1.7809 => 2.1089, std.dev.: 0.0031)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 6.42% (20.8247 => 22.1626, std.dev.: 0.0237)
  SingleSource/UnitTests/Vector/multiplies: 5.92% (0.5561 => 0.5890, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.45% (0.1871 => 0.1973, std.dev.: 0.0010)
  SingleSource/Benchmarks/McGill/misr: 5.14% (0.3771 => 0.3965, std.dev.: 0.0062)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.97% (5.3716 => 5.6383, std.dev.: 0.0128)
  MultiSource/Applications/lua/lua: 3.67% (29.5202 => 30.6036, std.dev.: 0.3865)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.28% (4.4696 => 4.6162, std.dev.: 0.0113)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.38% (2.1472 => 2.1984, std.dev.: 0.0072)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.28% (0.5182 => 0.5300, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.98% (3.1569 => 3.2195, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.33% (1.6707 => 1.6930, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.21% (5.3022 => 5.3662, std.dev.: 0.0196)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.19% (16.7972 => 16.9971, std.dev.: 0.0500)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.13% (6.6028 => 6.6771, std.dev.: 0.0071)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.17% (0.1483 => 0.1169, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -6.65% (0.1956 => 0.1826, std.dev.: 0.0014)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.93% (0.2193 => 0.2063, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -19.80% (57.2347 => 45.9026, std.dev.: 1.0621)
  MultiSource/Benchmarks/FreeBench/mason/mason: -10.93% (0.3304 => 0.2943, std.dev.: 0.0132)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.60% (3.7437 => 3.4590, std.dev.: 0.0098)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.33% (3.0561 => 2.8322, std.dev.: 0.0459)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.52% (0.3462 => 0.3340, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.51% (2.5938 => 2.5286, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.21% (17.1431 => 16.7638, std.dev.: 0.0395)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.48% (3.8582 => 3.8010, std.dev.: 0.0065)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.38% (89.7126 => 88.4704, std.dev.: 0.4039)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.15% (0.1348 => 0.1350, std.dev.: 0.0395)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130912/d7c8a3dd/attachment.html>


More information about the llvm-testresults mailing list