[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 26 16:20:21 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14817?compare_to=14813&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14817, Order: 189278, Start Time: 2013-08-26 21:31:31, End Time: 2013-08-26 23:22:34
      To: 14813, Order: 189250, Start Time: 2013-08-26 19:09:08, End Time: 2013-08-26 21:05:00
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 4 (25 on baseline)
Performance Improvements: 20 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1083 (1053 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.65% (1.4793 => 1.8883, std.dev.: 0.0123)
  MultiSource/Applications/minisat/minisat: 25.82% (6.4281 => 8.0878, std.dev.: 0.4721)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.12% (1.5963 => 1.6301, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.02% (1.0576 => 1.0684, std.dev.: 0.0031)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Stanford/Oscar: -32.71% (0.1076 => 0.0724, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/ary2: -23.01% (0.3903 => 0.3005, std.dev.: 0.0217)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -18.12% (0.0618 => 0.0506, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -15.49% (1.9737 => 1.6680, std.dev.: 0.0540)
  MultiSource/Applications/JM/lencod/lencod: -13.59% (20.6446 => 17.8393, std.dev.: 0.4506)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -12.42% (0.2093 => 0.1833, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -12.38% (0.4111 => 0.3602, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -11.81% (1.6471 => 1.4525, std.dev.: 0.0754)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -11.57% (0.1296 => 0.1146, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -10.51% (0.1561 => 0.1397, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -9.89% (1.6181 => 1.4580, std.dev.: 0.0320)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -9.37% (0.3436 => 0.3114, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -7.74% (0.2777 => 0.2562, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.53% (1.0259 => 0.9999, std.dev.: 0.0064)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Bubblesort: -37.96% (0.0627 => 0.0389, std.dev.: 0.0078)
  SingleSource/Benchmarks/Stanford/Quicksort: -30.14% (0.0355 => 0.0248, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/ary2: -27.98% (0.0504 => 0.0363, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.68% (0.8483 => 0.7747, std.dev.: 0.0175)
  SingleSource/Benchmarks/Misc/flops-8: -2.32% (2.6119 => 2.5514, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.71% (3.8379 => 3.7723, std.dev.: 0.0132)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.44% (0.1316 => 0.1335, std.dev.: 0.0150)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.44% (0.9761 => 0.9999, std.dev.: 0.0064)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.14% (3.7285 => 6.2317, std.dev.: 0.3061)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.34% (2.8867 => 4.3110, std.dev.: 0.0256)
  MultiSource/Benchmarks/FreeBench/neural/neural: 33.24% (0.3171 => 0.4225, std.dev.: 0.0058)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.64% (1.5030 => 1.8883, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout/hash: 23.18% (4.1846 => 5.1544, std.dev.: 0.1141)
  SingleSource/Benchmarks/Shootout-C++/hash: 23.07% (0.6295 => 0.7747, std.dev.: 0.0175)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.11% (7.0762 => 7.8621, std.dev.: 0.0559)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.24% (0.1678 => 0.1833, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.22% (5.4910 => 5.9973, std.dev.: 0.0791)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3611, std.dev.: 0.0222)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.24% (48.3256 => 52.3079, std.dev.: 0.3351)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.17% (14.9584 => 16.1806, std.dev.: 0.2105)
  MultiSource/Applications/JM/lencod/lencod: 7.39% (7.1799 => 7.7103, std.dev.: 0.1587)
  MultiSource/Applications/oggenc/oggenc: 6.98% (0.1690 => 0.1808, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.68% (3.2027 => 3.4168, std.dev.: 0.0639)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.02% (5.3042 => 5.6237, std.dev.: 0.0475)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.93% (5.5008 => 5.8271, std.dev.: 0.0835)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.65% (3.4085 => 3.6011, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.36% (4.3151 => 4.5034, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3652, std.dev.: 0.0697)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.39% (25.0200 => 25.8680, std.dev.: 0.1087)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.09% (4.8739 => 5.0246, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.92% (12.8625 => 13.2381, std.dev.: 0.0698)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.16% (1.5957 => 1.6301, std.dev.: 0.0055)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.00% (0.2237 => 0.1454, std.dev.: 0.0194)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.78% (0.1072 => 0.0742, std.dev.: 0.0110)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.53% (1.1012 => 1.0073, std.dev.: 0.0164)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.45% (2.1022 => 1.4201, std.dev.: 0.0134)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.27% (0.0816 => 0.0569, std.dev.: 0.0005)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.10% (0.1189 => 0.0843, std.dev.: 0.0025)
  MultiSource/Applications/viterbi/viterbi: -27.25% (3.4923 => 2.5408, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.61% (6.9552 => 5.2436, std.dev.: 0.2435)
  MultiSource/Applications/JM/ldecod/ldecod: -23.17% (0.0859 => 0.0660, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.1843)
  SingleSource/Benchmarks/Misc/mandel: -14.00% (1.1996 => 1.0316, std.dev.: 0.0130)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.14% (0.5173 => 0.4700, std.dev.: 0.0038)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.54% (47.2250 => 44.6080, std.dev.: 0.9146)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.06% (1.7207 => 1.6337, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc/fbench: -4.68% (4.9602 => 4.7279, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.68% (3.8119 => 3.6336, std.dev.: 0.0218)
  SingleSource/Regression/C/uint64_to_float: -4.48% (1.5184 => 1.4503, std.dev.: 0.0252)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.95% (1.1032 => 1.0596, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.75% (0.2854 => 0.2747, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.70% (0.7355 => 0.7083, std.dev.: 0.0042)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.59% (21.6864 => 20.9080, std.dev.: 0.2556)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.08% (1.1024 => 1.0684, std.dev.: 0.0031)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.99% (0.4783 => 0.4640, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.89% (6.1482 => 5.9703, std.dev.: 0.0296)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.37% (8.6172 => 8.4130, std.dev.: 0.0652)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.21% (1.8144 => 1.7743, std.dev.: 0.0060)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.03% (34.8438 => 34.1378, std.dev.: 0.0729)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.64% (2.1343 => 2.0993, std.dev.: 0.0064)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.25% (1.6737 => 1.6528, std.dev.: 0.0074)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.12% (0.1378 => 0.1335, std.dev.: 0.0150)

Report Time: 1.03s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130826/4fd865f7/attachment.html>


More information about the llvm-testresults mailing list