[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Nov 5 05:46:01 PST 2013


http://llvm.org/perf/db_default/v4/nts/17017?compare_to=17013&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 17017, Order: 194062, Start Time: 2013-11-05 11:53:06, End Time: 2013-11-05 13:49:33
      To: 17013, Order: 194054, Start Time: 2013-11-05 09:38:05, End Time: 2013-11-05 11:31:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 34 (51 on baseline)
Performance Improvements: 10 (18 on baseline)
Added Tests: 0 (2 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1038 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 61.08% (0.0740 => 0.1192, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 52.96% (0.1656 => 0.2533, std.dev.: 0.0284)
  MultiSource/Benchmarks/Olden/tsp/tsp: 52.81% (0.1352 => 0.2066, std.dev.: 0.0265)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 51.76% (0.2647 => 0.4017, std.dev.: 0.0152)
  MultiSource/Benchmarks/MallocBench/gs/gs: 50.31% (4.6418 => 6.9773, std.dev.: 0.2361)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 49.28% (0.7092 => 1.0587, std.dev.: 0.1035)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 35.06% (0.9502 => 1.2833, std.dev.: 0.1178)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 28.24% (1.9091 => 2.4482, std.dev.: 0.0822)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 25.41% (1.2749 => 1.5989, std.dev.: 0.1164)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.96% (5.5286 => 6.9088, std.dev.: 0.2752)
  MultiSource/Benchmarks/Bullet/bullet: 24.73% (34.2496 => 42.7180, std.dev.: 1.0908)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.30% (1.3345 => 1.6187, std.dev.: 0.0672)
  MultiSource/Applications/JM/lencod/lencod: 21.06% (17.1293 => 20.7369, std.dev.: 0.4325)
  MultiSource/Applications/viterbi/viterbi: 20.78% (0.2021 => 0.2441, std.dev.: 0.0056)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 20.04% (26.2955 => 31.5646, std.dev.: 0.0361)
  MultiSource/Applications/SIBsim4/SIBsim4: 17.50% (1.5300 => 1.7977, std.dev.: 0.0584)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 17.20% (1.3313 => 1.5603, std.dev.: 0.0383)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.81% (0.6422 => 0.7437, std.dev.: 0.0218)
  MultiSource/Benchmarks/PAQ8p/paq8p: 13.22% (2.5925 => 2.9352, std.dev.: 0.0709)
  MultiSource/Benchmarks/FreeBench/neural/neural: 10.80% (0.1842 => 0.2041, std.dev.: 0.0008)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 58.88% (0.6749 => 1.0723, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 58.52% (0.0581 => 0.0921, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/gs/gs: 49.36% (0.0855 => 0.1277, std.dev.: 0.0124)
  MultiSource/Benchmarks/llubenchmark/llu: 28.66% (2.0127 => 2.5895, std.dev.: 0.1386)
  SingleSource/Benchmarks/Shootout/matrix: 13.35% (1.7506 => 1.9843, std.dev.: 0.0611)
  MultiSource/Benchmarks/Olden/tsp/tsp: 7.92% (1.5482 => 1.6708, std.dev.: 0.0442)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.54% (1.0369 => 1.1151, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.21% (2.9623 => 3.1166, std.dev.: 0.0587)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.65% (0.6966 => 0.7290, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.78% (5.7808 => 5.9992, std.dev.: 0.0119)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.50% (0.5273 => 0.5405, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.88% (1.2786 => 1.3027, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.62% (4.2375 => 4.3061, std.dev.: 0.0161)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.58% (49.3425 => 50.1197, std.dev.: 0.1846)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: -41.06% (0.0526 => 0.0310, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -30.24% (0.2384 => 0.1663, std.dev.: 0.0068)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -16.67% (0.1338 => 0.1115, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.64% (0.4039 => 0.3892, std.dev.: 0.0055)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -40.23% (6.8256 => 4.0797, std.dev.: 0.3581)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -12.63% (0.2050 => 0.1791, std.dev.: 0.0077)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.01% (3.0550 => 2.8408, std.dev.: 0.0491)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -3.76% (24.3805 => 23.4626, std.dev.: 0.0208)
  SingleSource/Benchmarks/Shootout/fib2: -2.24% (3.6861 => 3.6037, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.83% (3.6574 => 3.5903, std.dev.: 0.0110)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 10.55% (0.1374 => 0.1519, std.dev.: 0.0169)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 70.29% (0.0700 => 0.1192, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/tsp/tsp: 59.29% (0.1297 => 0.2066, std.dev.: 0.0265)
  MultiSource/Benchmarks/FreeBench/mason/mason: 58.63% (0.0643 => 0.1020, std.dev.: 0.0146)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 54.46% (0.1098 => 0.1696, std.dev.: 0.0225)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 53.70% (0.1648 => 0.2533, std.dev.: 0.0284)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 52.45% (0.2635 => 0.4017, std.dev.: 0.0152)
  MultiSource/Benchmarks/MallocBench/gs/gs: 52.07% (4.5883 => 6.9773, std.dev.: 0.2361)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 50.45% (0.7037 => 1.0587, std.dev.: 0.1035)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 39.31% (0.9212 => 1.2833, std.dev.: 0.1178)
  MultiSource/Benchmarks/Bullet/bullet: 30.42% (32.7552 => 42.7180, std.dev.: 1.0908)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.40% (1.8775 => 2.4482, std.dev.: 0.0822)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 28.24% (24.6139 => 31.5646, std.dev.: 0.0361)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 27.96% (1.2728 => 1.6287, std.dev.: 0.1276)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 26.30% (1.2660 => 1.5989, std.dev.: 0.1164)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 25.58% (5.5014 => 6.9088, std.dev.: 0.2752)
  MultiSource/Applications/JM/lencod/lencod: 24.99% (16.5902 => 20.7369, std.dev.: 0.4325)
  MultiSource/Applications/viterbi/viterbi: 23.53% (0.1976 => 0.2441, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 22.30% (1.3235 => 1.6187, std.dev.: 0.0672)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 19.40% (1.3068 => 1.5603, std.dev.: 0.0383)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 18.12% (0.6296 => 0.7437, std.dev.: 0.0218)
  MultiSource/Applications/SIBsim4/SIBsim4: 17.24% (1.5333 => 1.7977, std.dev.: 0.0584)
  MultiSource/Benchmarks/PAQ8p/paq8p: 14.36% (2.5666 => 2.9352, std.dev.: 0.0709)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 14.00% (0.2908 => 0.3315, std.dev.: 0.0156)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.45% (0.1882 => 0.2041, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 6.67% (0.3345 => 0.3568, std.dev.: 0.0039)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.38% (0.2949 => 0.3137, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.02% (1.2652 => 1.2907, std.dev.: 0.0066)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 121.42% (0.7410 => 1.6407, std.dev.: 0.3458)
  MultiSource/Benchmarks/Olden/bisort/bisort: 61.32% (0.6647 => 1.0723, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 56.63% (0.0588 => 0.0921, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.22% (4.4696 => 6.9379, std.dev.: 0.2443)
  MultiSource/Benchmarks/MallocBench/gs/gs: 55.16% (0.0823 => 0.1277, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout-C++/methcall: 51.61% (7.6426 => 11.5866, std.dev.: 0.2900)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.04% (2.8554 => 4.1701, std.dev.: 0.0533)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 36.66% (4.2391 => 5.7932, std.dev.: 0.1902)
  MultiSource/Benchmarks/llubenchmark/llu: 30.20% (1.9889 => 2.5895, std.dev.: 0.1386)
  MultiSource/Benchmarks/McCat/09-vor/vor: 15.44% (0.1140 => 0.1316, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout/matrix: 11.42% (1.7809 => 1.9843, std.dev.: 0.0611)
  SingleSource/Benchmarks/McGill/misr: 9.94% (0.3771 => 0.4146, std.dev.: 0.0105)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.95% (96.7834 => 105.4428, std.dev.: 2.0287)
  MultiSource/Benchmarks/Olden/tsp/tsp: 7.43% (1.5553 => 1.6708, std.dev.: 0.0442)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.11% (2.9372 => 3.1166, std.dev.: 0.0587)
  MultiSource/Applications/spiff/spiff: 5.35% (2.8194 => 2.9702, std.dev.: 0.0113)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.02% (1.2516 => 1.3144, std.dev.: 0.0219)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.30% (0.5182 => 0.5405, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.26% (1.0695 => 1.1151, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.87% (5.7757 => 5.9992, std.dev.: 0.0119)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.54% (2.5368 => 2.6266, std.dev.: 0.0135)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.28% (89.7126 => 92.6507, std.dev.: 0.4917)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.02% (1.2896 => 1.3027, std.dev.: 0.0044)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.70% (0.1483 => 0.1176, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -76.61% (57.2347 => 13.3860, std.dev.: 0.0133)
  MultiSource/Benchmarks/FreeBench/neural/neural: -49.56% (0.5226 => 0.2636, std.dev.: 0.0369)
  MultiSource/Applications/sgefa/sgefa: -42.58% (1.5790 => 0.9067, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -19.70% (4.0181 => 3.2265, std.dev.: 0.1668)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.01% (15.9508 => 13.0780, std.dev.: 0.2080)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.40% (20.8247 => 17.8262, std.dev.: 0.2682)
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.79% (5.0002 => 4.3107, std.dev.: 0.1121)
  MultiSource/Applications/SIBsim4/SIBsim4: -11.56% (3.7437 => 3.3108, std.dev.: 0.0540)
  SingleSource/Benchmarks/Shootout-C++/strcat: -10.66% (0.0957 => 0.0855, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.53% (3.4956 => 3.1275, std.dev.: 0.0302)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.04% (3.0561 => 2.8408, std.dev.: 0.0491)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.81% (2.5938 => 2.4949, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.39% (17.1431 => 16.5621, std.dev.: 0.0882)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.78% (3.7874 => 3.6822, std.dev.: 0.0076)
  MultiSource/Benchmarks/Olden/power/power: -2.37% (1.2170 => 1.1881, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc/whetstone: -1.64% (3.6303 => 3.5708, std.dev.: 0.0129)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.22% (4.3592 => 4.3061, std.dev.: 0.0161)

Added Tests - Compile Time
--------------------------
  SingleSource/Regression/C/PR10189

Added Tests - Execution Time
----------------------------
  SingleSource/Regression/C/PR10189

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 12.69% (0.1348 => 0.1519, std.dev.: 0.0169)

Report Time: 1.14s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131105/4205e7ed/attachment.html>


More information about the llvm-testresults mailing list