[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Sep 18 20:07:10 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15439?compare_to=15436&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15439, Order: 190980, Start Time: 2013-09-19 01:21:11, End Time: 2013-09-19 03:09:49
      To: 15436, Order: 190964, Start Time: 2013-09-18 23:03:33, End Time: 2013-09-19 00:56:52
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (34 on baseline)
Performance Improvements: 41 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1044 (1058 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-4: 86.96% (0.0322 => 0.0602, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 64.59% (0.0257 => 0.0423, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/lists: 36.89% (0.2876 => 0.3937, std.dev.: 0.0408)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.74% (6.3395 => 7.0201, std.dev.: 0.2230)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 9.71% (0.3317 => 0.3639, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.61% (1.3125 => 1.3467, std.dev.: 0.0087)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 50.33% (4.6138 => 6.9360, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout/ary3: 22.16% (4.7660 => 5.8222, std.dev.: 0.0581)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.84% (2.1124 => 2.3836, std.dev.: 0.0273)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 9.41% (2.3426 => 2.5631, std.dev.: 0.0155)
  SingleSource/Regression/C/uint64_to_float: 6.69% (1.3936 => 1.4869, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.54% (2.6549 => 2.8019, std.dev.: 0.0411)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.31% (6.0139 => 6.3331, std.dev.: 0.0368)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 5.00% (2.4699 => 2.5935, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/salsa20: 4.41% (7.8479 => 8.1943, std.dev.: 0.0142)
  SingleSource/Benchmarks/Misc/flops-4: 4.16% (1.7261 => 1.7979, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.88% (4.4041 => 4.5748, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.10% (5.7099 => 5.8297, std.dev.: 0.0452)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.98% (4.1285 => 4.2102, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.98% (5.2998 => 5.4045, std.dev.: 0.0122)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.36% (3.6353 => 3.6847, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.04% (5.9004 => 5.9617, std.dev.: 0.0204)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -44.12% (0.1786 => 0.0998, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -38.52% (0.1259 => 0.0774, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -32.25% (0.8430 => 0.5711, std.dev.: 0.0881)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -31.40% (1.0305 => 0.7069, std.dev.: 0.1247)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -31.17% (0.4001 => 0.2754, std.dev.: 0.0203)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -29.64% (0.5323 => 0.3745, std.dev.: 0.0508)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.15% (6.5805 => 4.6623, std.dev.: 0.7432)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -26.77% (2.1826 => 1.5984, std.dev.: 0.1254)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -25.43% (6.6892 => 4.9880, std.dev.: 0.0988)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -22.99% (7.2443 => 5.5789, std.dev.: 0.6086)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -22.11% (6.3341 => 4.9336, std.dev.: 0.2673)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -21.84% (2.1012 => 1.6422, std.dev.: 0.0746)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -21.45% (1.2530 => 0.9842, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -19.58% (0.6005 => 0.4829, std.dev.: 0.0158)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -18.76% (5.7774 => 4.6936, std.dev.: 0.1184)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -18.09% (2.3359 => 1.9133, std.dev.: 0.0452)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -14.91% (0.1710 => 0.1455, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.55% (8.7378 => 7.4662, std.dev.: 0.3464)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -14.12% (0.1721 => 0.1478, std.dev.: 0.0068)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -13.95% (53.0396 => 45.6427, std.dev.: 0.8275)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -13.90% (17.1322 => 14.7511, std.dev.: 0.7046)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -13.01% (0.7280 => 0.6333, std.dev.: 0.0211)
  MultiSource/Benchmarks/Bullet/bullet: -12.75% (38.4842 => 33.5764, std.dev.: 0.7853)
  MultiSource/Benchmarks/mafft/pairlocalalign: -12.70% (11.8045 => 10.3058, std.dev.: 0.2852)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -10.83% (28.6443 => 25.5420, std.dev.: 0.5254)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -9.71% (1.2201 => 1.1016, std.dev.: 0.0363)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -8.12% (0.2894 => 0.2659, std.dev.: 0.0058)
  SingleSource/UnitTests/Vector/constpool: -7.66% (9.5485 => 8.8170, std.dev.: 0.2443)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -7.19% (0.1781 => 0.1653, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -6.96% (0.1825 => 0.1698, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.67% (0.3510 => 0.3276, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -39.14% (0.0700 => 0.0426, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -30.06% (0.0336 => 0.0235, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -22.83% (3.1403 => 2.4233, std.dev.: 0.1327)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -20.29% (0.4387 => 0.3497, std.dev.: 0.0058)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -19.12% (35.5233 => 28.7320, std.dev.: 1.8685)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -13.16% (24.8713 => 21.5973, std.dev.: 0.7571)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -11.32% (47.6870 => 42.2875, std.dev.: 0.4834)
  SingleSource/Benchmarks/Linpack/linpack-pc: -7.34% (47.2602 => 43.7917, std.dev.: 0.3577)
  SingleSource/Benchmarks/Shootout/matrix: -6.29% (1.8856 => 1.7670, std.dev.: 0.0057)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.83% (2.6971 => 2.5399, std.dev.: 0.0231)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.52% (0.1351 => 0.1344, std.dev.: 0.0261)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-4: 101.34% (0.0299 => 0.0602, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 68.53% (0.0251 => 0.0423, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/lists: 52.77% (0.2577 => 0.3937, std.dev.: 0.0408)
  SingleSource/Benchmarks/Shootout-C++/moments: 21.82% (0.3771 => 0.4594, std.dev.: 0.0212)
  SingleSource/Benchmarks/Misc/richards_benchmark: 17.10% (0.0772 => 0.0904, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.45% (6.0284 => 7.0201, std.dev.: 0.2230)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 11.52% (0.3263 => 0.3639, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.43% (4.0397 => 4.4206, std.dev.: 0.1315)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.81% (0.3096 => 0.3276, std.dev.: 0.0015)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.89% (0.5705 => 0.5927, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.67% (0.9494 => 0.9842, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.31% (1.3036 => 1.3467, std.dev.: 0.0087)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 52.51% (4.5479 => 6.9360, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout/ary3: 23.95% (4.6972 => 5.8222, std.dev.: 0.0581)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.70% (0.1374 => 0.1631, std.dev.: 0.0096)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.78% (36.8417 => 42.2875, std.dev.: 0.4834)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.91% (2.1111 => 2.3836, std.dev.: 0.0273)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.83% (4.9428 => 5.4781, std.dev.: 0.0051)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 9.70% (2.3365 => 2.5631, std.dev.: 0.0155)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.55% (3.9856 => 4.2467, std.dev.: 0.0276)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.42% (2.6579 => 2.8019, std.dev.: 0.0411)
  SingleSource/Benchmarks/Misc/salsa20: 5.10% (7.7964 => 8.1943, std.dev.: 0.0142)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.71% (4.0596 => 4.2102, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.67% (6.1088 => 6.3331, std.dev.: 0.0368)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.85% (8.1346 => 8.3665, std.dev.: 0.0808)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.44% (1.7652 => 1.8082, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.36% (5.6951 => 5.8297, std.dev.: 0.0452)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.35% (4.4696 => 4.5748, std.dev.: 0.0325)
  SingleSource/Regression/C/uint64_to_float: 2.35% (1.4528 => 1.4869, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4045, std.dev.: 0.0122)
  SingleSource/Benchmarks/Misc/flops: 1.85% (9.4433 => 9.6178, std.dev.: 0.0199)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.65% (2.5513 => 2.5935, std.dev.: 0.0061)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.61% (16.7972 => 17.0680, std.dev.: 0.0056)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.17% (0.1483 => 0.1169, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.04% (0.5226 => 0.2454, std.dev.: 0.0471)
  MultiSource/Applications/sgefa/sgefa: -47.06% (1.5790 => 0.8359, std.dev.: 0.0333)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -26.50% (0.0400 => 0.0294, std.dev.: 0.0008)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.49% (57.2347 => 43.7917, std.dev.: 0.3577)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.78% (15.9508 => 13.2736, std.dev.: 0.1193)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.12% (20.8247 => 18.5099, std.dev.: 0.1190)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.04% (50.0284 => 44.5052, std.dev.: 0.1884)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.13% (3.4956 => 3.1415, std.dev.: 0.0314)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.50% (2.5938 => 2.5029, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.10% (5.4473 => 5.2783, std.dev.: 0.0238)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.97% (17.1431 => 16.6338, std.dev.: 0.0895)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.85% (4.3592 => 4.2351, std.dev.: 0.0323)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.77% (2.4471 => 2.3792, std.dev.: 0.0222)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.56% (89.7126 => 88.3108, std.dev.: 0.3713)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.30% (0.1348 => 0.1344, std.dev.: 0.0261)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130918/000bad7f/attachment.html>


More information about the llvm-testresults mailing list