[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Sep 12 17:05:02 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15238?compare_to=15234&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15238, Order: 190632, Start Time: 2013-09-12 22:16:09, End Time: 2013-09-13 00:07:35
      To: 15234, Order: 190624, Start Time: 2013-09-12 20:06:48, End Time: 2013-09-12 21:54:55
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 41 (48 on baseline)
Performance Improvements: 3 (7 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 77.35% (0.0309 => 0.0548, std.dev.: 0.0014)
  SingleSource/Benchmarks/McGill/exptree: 76.78% (0.0969 => 0.1713, std.dev.: 0.0067)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 71.59% (0.0345 => 0.0592, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/hello: 69.14% (0.1795 => 0.3036, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/flops-8: 67.69% (0.0325 => 0.0545, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/ary3: 61.14% (0.0332 => 0.0535, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/ackermann: 55.19% (0.0241 => 0.0374, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/fbench: 52.93% (0.0733 => 0.1121, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/ary3: 25.02% (0.2542 => 0.3178, std.dev.: 0.0238)
  SingleSource/Benchmarks/McGill/queens: 20.57% (0.0530 => 0.0639, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.06% (2.7184 => 3.1005, std.dev.: 0.0142)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.18% (4.1463 => 4.6515, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 11.70% (0.1419 => 0.1585, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 11.03% (0.2094 => 0.2325, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.34% (0.2356 => 0.2576, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/moments: 9.16% (0.3822 => 0.4172, std.dev.: 0.0016)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 79.07% (0.0129 => 0.0231, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 69.15% (2.8512 => 4.8227, std.dev.: 0.0588)
  SingleSource/Benchmarks/Stanford/Towers: 52.25% (0.0222 => 0.0338, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.58% (5.2127 => 6.7024, std.dev.: 0.1493)
  SingleSource/Benchmarks/McGill/chomp: 12.87% (1.0275 => 1.1597, std.dev.: 0.0467)
  MultiSource/Benchmarks/nbench/nbench: 12.57% (19.7127 => 22.1911, std.dev.: 0.2787)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 9.29% (2.2468 => 2.4556, std.dev.: 0.0612)
  SingleSource/Benchmarks/Misc/salsa20: 8.94% (7.4939 => 8.1636, std.dev.: 0.0985)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.07% (3.5979 => 3.8523, std.dev.: 0.0895)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.79% (3.9604 => 4.2293, std.dev.: 0.0577)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.13% (7.6616 => 8.1314, std.dev.: 0.0170)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.83% (2.3669 => 2.5049, std.dev.: 0.0478)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.67% (2.6562 => 2.8069, std.dev.: 0.0507)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.42% (1.8186 => 1.8989, std.dev.: 0.0002)
  MultiSource/Applications/aha/aha: 4.30% (3.6148 => 3.7704, std.dev.: 0.0100)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.24% (2.1229 => 2.2130, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.60% (0.6336 => 0.6564, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.56% (5.7922 => 5.9985, std.dev.: 0.0088)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.37% (4.0984 => 4.2366, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 3.32% (1.2465 => 1.2879, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc/flops: 2.53% (9.3562 => 9.5927, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.09% (5.1435 => 5.2511, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.59% (5.9039 => 5.9976, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc/fbench: 1.53% (4.9115 => 4.9866, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.44% (5.5443 => 5.6241, std.dev.: 0.0058)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -2.88% (0.3998 => 0.3883, std.dev.: 0.0036)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.58% (4.4545 => 4.3394, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout/fib2: -1.26% (3.6415 => 3.5955, std.dev.: 0.0049)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.03% (0.1413 => 0.1356, std.dev.: 0.0222)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/McGill/exptree: 80.89% (0.0947 => 0.1713, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/fp-convert: 79.08% (0.0306 => 0.0548, std.dev.: 0.0014)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 76.72% (0.0335 => 0.0592, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/hello: 69.89% (0.1787 => 0.3036, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/flops-8: 69.25% (0.0322 => 0.0545, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/fbench: 59.01% (0.0705 => 0.1121, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout/ary3: 56.43% (0.0342 => 0.0535, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/ackermann: 52.03% (0.0246 => 0.0374, std.dev.: 0.0031)
  SingleSource/Benchmarks/McGill/queens: 27.04% (0.0503 => 0.0639, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/ary3: 25.02% (0.2542 => 0.3178, std.dev.: 0.0238)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 17.04% (2.6492 => 3.1005, std.dev.: 0.0142)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 15.14% (4.0397 => 4.6515, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.30% (6.0284 => 6.8904, std.dev.: 0.3111)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 12.73% (0.1406 => 0.1585, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 11.62% (0.2083 => 0.2325, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/moments: 10.63% (0.3771 => 0.4172, std.dev.: 0.0016)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 10.32% (0.2335 => 0.2576, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.88% (0.3096 => 0.3216, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.84% (1.3498 => 1.3747, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.63% (1.4033 => 1.4262, std.dev.: 0.0068)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: 647.37% (0.0019 => 0.0142, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/ary2: 79.07% (0.0129 => 0.0231, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 60.16% (3.0111 => 4.8227, std.dev.: 0.0588)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 47.37% (4.5479 => 6.7024, std.dev.: 0.1493)
  MultiSource/Applications/sgefa/sgefa: 22.48% (1.5790 => 1.9339, std.dev.: 0.1032)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.49% (0.1374 => 0.1628, std.dev.: 0.0033)
  SingleSource/Benchmarks/McGill/misr: 16.34% (0.3771 => 0.4387, std.dev.: 0.0235)
  SingleSource/Benchmarks/McGill/chomp: 14.13% (1.0161 => 1.1597, std.dev.: 0.0467)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.21% (2.3365 => 2.5049, std.dev.: 0.0478)
  SingleSource/UnitTests/Vector/multiplies: 6.51% (0.5561 => 0.5923, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.40% (7.6426 => 8.1314, std.dev.: 0.0170)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.11% (3.9856 => 4.2293, std.dev.: 0.0577)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.61% (2.6579 => 2.8069, std.dev.: 0.0507)
  MultiSource/Applications/aha/aha: 5.52% (3.5731 => 3.7704, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/salsa20: 4.71% (7.7964 => 8.1636, std.dev.: 0.0985)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.36% (4.0596 => 4.2366, std.dev.: 0.0059)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 4.28% (20.8247 => 21.7169, std.dev.: 0.1969)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.86% (5.7757 => 5.9985, std.dev.: 0.0088)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2130, std.dev.: 0.0012)
  MultiSource/Applications/siod/siod: 3.01% (3.5310 => 3.6374, std.dev.: 0.0149)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.54% (1.8519 => 1.8989, std.dev.: 0.0002)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.50% (1.7652 => 1.8094, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6241, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2202, std.dev.: 0.0017)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.61% (16.7972 => 17.0684, std.dev.: 0.0104)
  SingleSource/Benchmarks/Misc/flops: 1.58% (9.4433 => 9.5927, std.dev.: 0.0158)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.45% (1.6707 => 1.6950, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.00% (3.9552 => 3.9949, std.dev.: 0.0066)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -18.68% (0.1483 => 0.1206, std.dev.: 0.0017)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.07% (57.2347 => 47.4635, std.dev.: 3.7423)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.11% (0.3304 => 0.2904, std.dev.: 0.0034)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.27% (3.7437 => 3.4716, std.dev.: 0.0581)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.06% (17.1431 => 16.7905, std.dev.: 0.0502)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.97% (2.4471 => 2.3988, std.dev.: 0.0122)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.72% (89.7126 => 88.1696, std.dev.: 0.2821)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.59% (0.1348 => 0.1356, std.dev.: 0.0222)

Report Time: 1.41s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130912/3b4086bf/attachment.html>


More information about the llvm-testresults mailing list