[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 8 21:46:40 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14238?compare_to=14234&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14238, Order: 188047, Start Time: 2013-08-09 03:03:39, End Time: 2013-08-09 04:48:33
      To: 14234, Order: 188034, Start Time: 2013-08-09 00:52:39, End Time: 2013-08-09 02:42:11
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 9 (30 on baseline)
Performance Improvements: 10 (54 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1086 (1021 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 2.36% (1.4884 => 1.5235, std.dev.: 0.0131)
  SingleSource/UnitTests/Vector/constpool: 1.85% (8.8408 => 9.0041, std.dev.: 0.0296)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 1.71% (5.0415 => 5.1278, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.50% (1.3498 => 1.3701, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: 8.30% (8.2840 => 8.9713, std.dev.: 0.0024)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.96% (15.3672 => 16.2836, std.dev.: 0.2609)
  SingleSource/Benchmarks/Misc/flops: 4.30% (9.4153 => 9.8206, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.68% (2.5000 => 2.5921, std.dev.: 0.0236)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.98% (2.3323 => 2.3785, std.dev.: 0.0175)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/sieve: -3.58% (0.3324 => 0.3205, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.11% (0.5025 => 0.4919, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.00% (1.6895 => 1.4360, std.dev.: 0.0251)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.92% (4.2297 => 4.0214, std.dev.: 0.0790)
  SingleSource/Benchmarks/Shootout/hash: -4.38% (5.3701 => 5.1350, std.dev.: 0.0161)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.68% (62.6005 => 60.2943, std.dev.: 0.4668)
  SingleSource/Benchmarks/Shootout-C++/lists1: -3.48% (0.6204 => 0.5988, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.08% (2.8328 => 2.7456, std.dev.: 0.0076)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.88% (2.6661 => 2.5893, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.87% (8.5679 => 8.4075, std.dev.: 0.0017)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -10.93% (0.1491 => 0.1328, std.dev.: 0.0074)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.44% (0.2729 => 0.2717, std.dev.: 0.0016)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.46% (0.0274 => 0.0278, std.dev.: 0.0002)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.41% (0.2813 => 0.2717, std.dev.: 0.0016)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.42% (0.0345 => 0.0278, std.dev.: 0.0002)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 37.98% (0.0466 => 0.0643, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/oourafft: 4.86% (0.2284 => 0.2395, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.69% (0.3546 => 0.3677, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.08% (0.9761 => 0.9964, std.dev.: 0.0057)
  SingleSource/UnitTests/Vector/constpool: 1.59% (8.8630 => 9.0041, std.dev.: 0.0296)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.11% (1.9317 => 1.9531, std.dev.: 0.0003)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.26% (3.7285 => 6.2362, std.dev.: 0.1680)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.43% (2.8867 => 4.2846, std.dev.: 0.0020)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.16% (0.3171 => 0.4381, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout/hash: 22.71% (4.1846 => 5.1350, std.dev.: 0.0161)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.95% (7.0762 => 7.8512, std.dev.: 0.0512)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.86% (14.9584 => 16.2836, std.dev.: 0.2609)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.38% (1.2557 => 1.3609, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.36% (5.4910 => 5.9503, std.dev.: 0.0285)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.92% (48.3256 => 52.1523, std.dev.: 0.0080)
  SingleSource/Benchmarks/McGill/chomp: 6.93% (1.0051 => 1.0748, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.88% (3.2027 => 3.4231, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6226, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.68% (3.4085 => 3.6021, std.dev.: 0.0305)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.48% (5.5008 => 5.8020, std.dev.: 0.0971)
  MultiSource/Applications/siod/siod: 4.72% (3.3761 => 3.5354, std.dev.: 0.0469)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.33% (5.1471 => 5.3698, std.dev.: 0.0655)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.32% (4.3151 => 4.5015, std.dev.: 0.0212)
  SingleSource/Benchmarks/Misc/whetstone: 3.95% (3.4559 => 3.5923, std.dev.: 0.0031)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.25% (25.0200 => 25.8343, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (3.3877 => 3.4897, std.dev.: 0.0226)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.70% (2.5240 => 2.5921, std.dev.: 0.0236)
  MultiSource/Applications/spiff/spiff: 2.66% (2.7609 => 2.8344, std.dev.: 0.0094)
  SingleSource/Benchmarks/Shootout/matrix: 2.16% (1.7358 => 1.7733, std.dev.: 0.0011)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.85% (1.4398 => 1.4664, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.21% (0.2237 => 0.1494, std.dev.: 0.0114)
  MultiSource/Applications/obsequi/Obsequi: -18.69% (1.4685 => 1.1941, std.dev.: 0.0236)
  SingleSource/Benchmarks/Misc/perlin: -16.74% (0.0663 => 0.0552, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.25% (0.1870 => 0.1641, std.dev.: 0.0020)
  MultiSource/Applications/JM/ldecod/ldecod: -11.66% (8.6720 => 7.6605, std.dev.: 0.0315)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.79% (0.3073 => 0.2803, std.dev.: 0.0023)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.35% (1.1012 => 1.0203, std.dev.: 0.0201)
  MultiSource/Applications/oggenc/oggenc: -5.80% (6.1121 => 5.7574, std.dev.: 0.1331)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.73% (1.6226 => 1.5297, std.dev.: 0.0107)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.08% (2.6853 => 2.5489, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.32% (1.4783 => 1.4145, std.dev.: 0.0127)
  MultiSource/Applications/SPASS/SPASS: -3.77% (17.9111 => 17.2367, std.dev.: 0.1011)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.58% (1.5629 => 1.5070, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.53% (1.4947 => 1.4419, std.dev.: 0.0140)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.98% (5.2851 => 5.1278, std.dev.: 0.0171)
  MultiSource/Applications/spiff/spiff: -1.31% (0.9578 => 0.9453, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -38.19% (1.4194 => 0.8774, std.dev.: 0.2022)
  SingleSource/Benchmarks/Stanford/Towers: -36.56% (0.0279 => 0.0177, std.dev.: 0.0021)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.50% (2.1022 => 1.4190, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.15% (0.0816 => 0.0570, std.dev.: 0.0046)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.68% (0.1189 => 0.0848, std.dev.: 0.0003)
  MultiSource/Applications/viterbi/viterbi: -27.53% (3.4923 => 2.5307, std.dev.: 0.2665)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2421, std.dev.: 0.3475)
  MultiSource/Applications/JM/ldecod/ldecod: -24.10% (0.0859 => 0.0652, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6170, std.dev.: 0.0001)
  MultiSource/Applications/obsequi/Obsequi: -18.84% (2.6081 => 2.1168, std.dev.: 0.0725)
  SingleSource/Benchmarks/Misc/mandel: -14.74% (1.1996 => 1.0228, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.37% (0.3557 => 0.3117, std.dev.: 0.0117)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -10.92% (1.6121 => 1.4360, std.dev.: 0.0251)
  SingleSource/Benchmarks/Shootout/strcat: -10.80% (0.1593 => 0.1421, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.32% (0.5173 => 0.4639, std.dev.: 0.0018)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.80% (3.5791 => 3.3001, std.dev.: 0.0723)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -6.07% (0.8928 => 0.8386, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.86% (0.4969 => 0.4678, std.dev.: 0.0076)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.15% (1.7207 => 1.6321, std.dev.: 0.0163)
  SingleSource/Regression/C/uint64_to_float: -4.91% (1.5184 => 1.4439, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/fbench: -4.50% (4.9602 => 4.7372, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.39% (0.7355 => 0.7032, std.dev.: 0.0007)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.27% (2.7049 => 2.5893, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.19% (1.1024 => 1.0562, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.17% (0.2854 => 0.2735, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.78% (0.7806 => 0.7511, std.dev.: 0.0065)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.70% (21.6864 => 20.8833, std.dev.: 0.0927)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9622, std.dev.: 0.0269)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.74% (5.2218 => 5.0789, std.dev.: 0.0467)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.43% (8.6172 => 8.4075, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/oourafft: -2.40% (3.7891 => 3.6982, std.dev.: 0.0038)
  MultiSource/Applications/sgefa/sgefa: -2.39% (1.4030 => 1.3694, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.12% (2.8052 => 2.7456, std.dev.: 0.0076)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.12% (29.8131 => 29.1811, std.dev.: 0.0456)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1387, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.43% (5.8810 => 5.7967, std.dev.: 0.0255)
  SingleSource/Benchmarks/Shootout/lists: -1.36% (7.2315 => 7.1332, std.dev.: 0.0188)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.35% (16.5294 => 16.3057, std.dev.: 0.0317)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.63% (0.1378 => 0.1328, std.dev.: 0.0074)

Report Time: 2.29s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130808/b9bee23e/attachment.html>


More information about the llvm-testresults mailing list