[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Nov 1 18:09:32 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16912?compare_to=16908&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16912, Order: 193892, Start Time: 2013-11-01 23:15:14, End Time: 2013-11-02 01:13:02
      To: 16908, Order: 193878, Start Time: 2013-11-01 20:51:51, End Time: 2013-11-01 22:47:49
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 53 (78 on baseline)
Performance Improvements: 6 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1048 (1011 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/richards_benchmark: 80.73% (0.0799 => 0.1444, std.dev.: 0.0144)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 59.96% (0.1104 => 0.1766, std.dev.: 0.0061)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 46.33% (0.1826 => 0.2672, std.dev.: 0.0225)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 46.26% (0.0361 => 0.0528, std.dev.: 0.0016)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 46.20% (0.1078 => 0.1576, std.dev.: 0.0155)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 45.80% (0.0762 => 0.1111, std.dev.: 0.0078)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 44.31% (1.1753 => 1.6961, std.dev.: 0.1639)
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 38.67% (0.0331 => 0.0459, std.dev.: 0.0010)
  MultiSource/Applications/spiff/spiff: 37.33% (0.9132 => 1.2541, std.dev.: 0.0583)
  MultiSource/Benchmarks/McCat/08-main/main: 35.45% (0.3123 => 0.4230, std.dev.: 0.0410)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 32.60% (0.1098 => 0.1456, std.dev.: 0.0085)
  MultiSource/Applications/hbd/hbd: 32.28% (1.6229 => 2.1467, std.dev.: 0.1290)
  MultiSource/Benchmarks/MallocBench/gs/gs: 31.91% (5.0506 => 6.6620, std.dev.: 0.5737)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 31.82% (1.2147 => 1.6012, std.dev.: 0.0739)
  MultiSource/Benchmarks/Prolangs-C/football/football: 28.25% (0.9966 => 1.2781, std.dev.: 0.0564)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.74% (0.9373 => 1.1786, std.dev.: 0.0484)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 25.64% (1.3356 => 1.6781, std.dev.: 0.1070)
  MultiSource/Applications/lua/lua: 21.79% (4.3797 => 5.3339, std.dev.: 0.2499)
  MultiSource/Applications/hexxagon/hexxagon: 16.62% (1.0592 => 1.2352, std.dev.: 0.0597)
  MultiSource/Applications/d/make_dparser: 16.30% (3.5630 => 4.1438, std.dev.: 0.2008)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 16.14% (1.7431 => 2.0244, std.dev.: 0.0767)
  MultiSource/Applications/siod/siod: 16.13% (2.5493 => 2.9605, std.dev.: 0.1262)
  MultiSource/Applications/kimwitu++/kc: 16.05% (19.9060 => 23.1005, std.dev.: 0.4300)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 15.84% (0.5114 => 0.5924, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 15.36% (1.2750 => 1.4708, std.dev.: 0.0384)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.17% (5.9660 => 6.8711, std.dev.: 0.3434)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 14.54% (0.3280 => 0.3757, std.dev.: 0.0016)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.52% (0.8464 => 0.9693, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 12.84% (1.3029 => 1.4702, std.dev.: 0.0454)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 12.64% (6.3062 => 7.1031, std.dev.: 0.0807)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/d/make_dparser: 60.10% (0.0381 => 0.0610, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 55.73% (4.6070 => 7.1747, std.dev.: 0.1759)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 39.62% (0.1411 => 0.1970, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 36.70% (0.1218 => 0.1665, std.dev.: 0.0079)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.28% (1.4849 => 1.8752, std.dev.: 0.1101)
  MultiSource/Benchmarks/llubenchmark/llu: 25.42% (2.0871 => 2.6176, std.dev.: 0.0877)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 24.85% (1.5705 => 1.9607, std.dev.: 0.1035)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 20.90% (3.0264 => 3.6588, std.dev.: 0.0054)
  MultiSource/Benchmarks/McCat/08-main/main: 19.18% (0.0777 => 0.0926, std.dev.: 0.0011)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.04% (1.4076 => 1.5911, std.dev.: 0.0285)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.90% (2.1018 => 2.3730, std.dev.: 0.0096)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.74% (0.8975 => 0.9849, std.dev.: 0.0337)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.11% (4.1119 => 4.4454, std.dev.: 0.0891)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.84% (2.6841 => 2.8946, std.dev.: 0.0560)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.16% (6.1656 => 6.6071, std.dev.: 0.0411)
  SingleSource/Benchmarks/Misc/salsa20: 6.45% (7.6681 => 8.1628, std.dev.: 0.0171)
  MultiSource/Benchmarks/Olden/bh/bh: 6.14% (2.4368 => 2.5864, std.dev.: 0.0071)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 6.01% (1.4150 => 1.5001, std.dev.: 0.0218)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.81% (3.9991 => 4.1916, std.dev.: 0.0175)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.43% (12.9856 => 13.5611, std.dev.: 0.1106)
  SingleSource/Benchmarks/Misc/flops: 3.96% (9.2723 => 9.6399, std.dev.: 0.0242)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.81% (0.7344 => 0.7550, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.87% (1.5965 => 1.6264, std.dev.: 0.0059)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/five11/five11: -28.49% (0.0916 => 0.0655, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -11.65% (1.0632 => 0.9393, std.dev.: 0.0273)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -12.08% (4.8973 => 4.3057, std.dev.: 0.1818)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.04% (3.4327 => 3.3283, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout-C++/lists1: -2.24% (0.6065 => 0.5929, std.dev.: 0.0009)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.50% (12.3299 => 12.1444, std.dev.: 0.0689)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.11% (0.1325 => 0.1353, std.dev.: 0.0271)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 116.51% (0.0212 => 0.0459, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 90.61% (0.0277 => 0.0528, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/richards_benchmark: 87.05% (0.0772 => 0.1444, std.dev.: 0.0144)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 79.84% (0.0982 => 0.1766, std.dev.: 0.0061)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 61.26% (0.1657 => 0.2672, std.dev.: 0.0225)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 55.27% (0.1015 => 0.1576, std.dev.: 0.0155)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 48.53% (0.0748 => 0.1111, std.dev.: 0.0078)
  MultiSource/Benchmarks/McCat/08-main/main: 47.39% (0.2870 => 0.4230, std.dev.: 0.0410)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 46.47% (1.1580 => 1.6961, std.dev.: 0.1639)
  MultiSource/Benchmarks/MallocBench/gs/gs: 45.20% (4.5883 => 6.6620, std.dev.: 0.5737)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 43.73% (0.1013 => 0.1456, std.dev.: 0.0085)
  MultiSource/Applications/spiff/spiff: 40.74% (0.8911 => 1.2541, std.dev.: 0.0583)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 40.54% (1.1393 => 1.6012, std.dev.: 0.0739)
  MultiSource/Benchmarks/McCat/09-vor/vor: 40.40% (0.3480 => 0.4886, std.dev.: 0.0502)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 36.86% (1.4792 => 2.0244, std.dev.: 0.0767)
  MultiSource/Applications/hbd/hbd: 36.77% (1.5696 => 2.1467, std.dev.: 0.1290)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 36.76% (0.6868 => 0.9393, std.dev.: 0.0273)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 35.99% (0.8667 => 1.1786, std.dev.: 0.0484)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 34.54% (1.6047 => 2.1589, std.dev.: 0.0719)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 32.75% (1.2499 => 1.6592, std.dev.: 0.0828)
  MultiSource/Applications/obsequi/Obsequi: 30.90% (1.1551 => 1.5120, std.dev.: 0.0844)
  MultiSource/Benchmarks/Prolangs-C/football/football: 30.05% (0.9828 => 1.2781, std.dev.: 0.0564)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.87% (1.3123 => 1.6781, std.dev.: 0.1070)
  MultiSource/Applications/lua/lua: 26.27% (4.2242 => 5.3339, std.dev.: 0.2499)
  MultiSource/Applications/kimwitu++/kc: 25.81% (18.3608 => 23.1005, std.dev.: 0.4300)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 24.90% (5.5014 => 6.8711, std.dev.: 0.3434)
  MultiSource/Applications/siod/siod: 20.94% (2.4480 => 2.9605, std.dev.: 0.1262)
  MultiSource/Applications/hexxagon/hexxagon: 20.20% (1.0276 => 1.2352, std.dev.: 0.0597)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 19.24% (1.0756 => 1.2825, std.dev.: 0.0767)
  MultiSource/Applications/d/make_dparser: 18.52% (3.4962 => 4.1438, std.dev.: 0.2008)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.83% (6.0284 => 7.1031, std.dev.: 0.0807)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 17.73% (0.8233 => 0.9693, std.dev.: 0.0371)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 17.40% (0.5046 => 0.5924, std.dev.: 0.0263)
  MultiSource/Benchmarks/Bullet/bullet: 17.22% (32.7552 => 38.3949, std.dev.: 1.5774)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 17.21% (1.2553 => 1.4713, std.dev.: 0.0581)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 16.45% (1.2630 => 1.4708, std.dev.: 0.0384)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 16.13% (1.2660 => 1.4702, std.dev.: 0.0454)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 15.99% (1.3042 => 1.5127, std.dev.: 0.0750)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 15.14% (0.3263 => 0.3757, std.dev.: 0.0016)
  MultiSource/Benchmarks/mafft/pairlocalalign: 11.16% (9.9903 => 11.1053, std.dev.: 0.3036)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 67.51% (0.0994 => 0.1665, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.02% (7.6426 => 12.3059, std.dev.: 0.0338)
  MultiSource/Applications/d/make_dparser: 58.85% (0.0384 => 0.0610, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 57.76% (4.5479 => 7.1747, std.dev.: 0.1759)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.34% (4.4696 => 6.9432, std.dev.: 0.0746)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 49.18% (1.3143 => 1.9607, std.dev.: 0.1035)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.87% (2.8554 => 4.1936, std.dev.: 0.1031)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 36.67% (4.2391 => 5.7934, std.dev.: 0.0466)
  MultiSource/Benchmarks/llubenchmark/llu: 31.61% (1.9889 => 2.6176, std.dev.: 0.0877)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.45% (1.4830 => 1.8752, std.dev.: 0.1101)
  MultiSource/Applications/obsequi/Obsequi: 25.16% (2.1884 => 2.7390, std.dev.: 0.0229)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.32% (1.3008 => 1.5911, std.dev.: 0.0285)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.65% (1.1431 => 1.3906, std.dev.: 0.0509)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 21.51% (3.0111 => 3.6588, std.dev.: 0.0054)
  MultiSource/Benchmarks/McCat/08-main/main: 21.36% (0.0763 => 0.0926, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 19.05% (0.8273 => 0.9849, std.dev.: 0.0337)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.37% (9.4586 => 11.1017, std.dev.: 0.3467)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.41% (2.1111 => 2.3730, std.dev.: 0.0096)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.69% (96.7834 => 107.1259, std.dev.: 2.8704)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 9.17% (0.1331 => 0.1453, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.91% (2.6579 => 2.8946, std.dev.: 0.0560)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.77% (3.1730 => 3.4513, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 8.40% (4.1011 => 4.4454, std.dev.: 0.0891)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.16% (6.1088 => 6.6071, std.dev.: 0.0411)
  MultiSource/Benchmarks/Olden/bh/bh: 7.95% (2.3959 => 2.5864, std.dev.: 0.0071)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0015)
  MultiSource/Applications/lua/lua: 6.39% (29.5202 => 31.4055, std.dev.: 0.1839)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 6.09% (1.4140 => 1.5001, std.dev.: 0.0218)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.61% (3.9691 => 4.1916, std.dev.: 0.0175)
  SingleSource/Benchmarks/Misc/salsa20: 4.70% (7.7964 => 8.1628, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.44% (5.9061 => 6.1090, std.dev.: 0.0694)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.13% (89.7126 => 92.5195, std.dev.: 0.3310)
  MultiSource/Applications/aha/aha: 3.03% (3.5731 => 3.6812, std.dev.: 0.0400)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.89% (0.3836 => 0.3947, std.dev.: 0.0035)
  MultiSource/Applications/hexxagon/hexxagon: 2.44% (14.7810 => 15.1413, std.dev.: 0.0277)
  SingleSource/Regression/C/uint64_to_float: 2.24% (1.4528 => 1.4854, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/flops: 2.08% (9.4433 => 9.6399, std.dev.: 0.0242)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.03% (1.5940 => 1.6264, std.dev.: 0.0059)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.97% (0.1483 => 0.1172, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sgefa/sgefa: -42.50% (1.5790 => 0.9080, std.dev.: 0.0164)
  MultiSource/Benchmarks/FreeBench/neural/neural: -41.22% (0.5226 => 0.3072, std.dev.: 0.0386)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -21.13% (4.0181 => 3.1692, std.dev.: 0.0212)
  SingleSource/Benchmarks/Shootout-C++/moments: -15.33% (0.1285 => 0.1088, std.dev.: 0.0071)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.98% (15.9508 => 13.5611, std.dev.: 0.1106)
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.89% (5.0002 => 4.3057, std.dev.: 0.1818)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -13.24% (20.8247 => 18.0684, std.dev.: 0.2631)
  SingleSource/Benchmarks/Linpack/linpack-pc: -13.04% (57.2347 => 49.7724, std.dev.: 0.3074)
  MultiSource/Applications/SIBsim4/SIBsim4: -11.10% (3.7437 => 3.3283, std.dev.: 0.0205)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.79% (2.5938 => 2.4956, std.dev.: 0.0284)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.21% (3.7874 => 3.6657, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.84% (5.4473 => 5.2924, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.32% (17.1431 => 16.7459, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.00% (4.3592 => 4.2721, std.dev.: 0.0118)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.85% (1.8519 => 1.8177, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc/oourafft: -1.65% (3.7484 => 3.6865, std.dev.: 0.0086)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.61% (2.4471 => 2.4078, std.dev.: 0.0084)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1348 => 0.1353, std.dev.: 0.0271)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131101/c84fc5ec/attachment.html>


More information about the llvm-testresults mailing list